/
Release notes for AWS SQS Collector
Document toolboxDocument toolbox

Release notes for AWS SQS Collector

Owned by Laszlo Frazer
Last updated: Jan 23, 2025
3 min read

Release

Released on

Release type

Details

Recommendations

Release

Released on

Release type

Details

Recommendations

v1.7.3

Jan 9, 2025

Improvements

Improvements

  • Removed visibility window, maximum messages, and timeout parameters from default configuration. These parameters are usually not needed.

Recommended Version

v1.7.2

Dec 17, 2024

Bug Fixes

Bug Fixes

  • Missing CloudTrail decorators

Upgrade

v1.7.1

Dec 10, 2024

Bug Fixes

Bug Fixes

  • sub pre operation

  • log operation

Upgrade

v1.7.0

Oct 16, 2024

Bug Fixes

FEATURES

Bug Fixes

  • Fixed control tower issue

  • Fixed bug with Falcon Data Replicator Large where logs were taking over an hour to finish

Features

  • Created custom tagging off of record field mapping

  • Created NLB logging service

  • Added INFO/DEBUG logging around each method so users can see size and timing

Upgrade

v1.6.4

Oct 7, 2024

Bug Fixes
Improvements

Features

  • Created custom tagging off of record field mapping

  • Added INF0/DEBUG logging around most methods so users can see size and timing

Bug Fixes

  • Fixed Dependency Issue

  • Fixed control tower issue

  • Fixed Falcon Data Replicator Large where logs were taking over an hour to finish

Upgrade

v1.6.3

Oct 7, 2024

Bug Fixes

Bug Fixes

  • Fixed Log Operations Bug

  • Added Backwards compatibility to control tower

  • Fixed Palo Alto Service for snappy decompression

Upgrade

v1.6.2

Sep 24, 2024

Bug Fixes

Bug Fixes

  • None type causing message processing to fail fdr_large, fixed

  • Added default region to initialization of sts client to prevent needing environment variables in the green cluster

  • Fixed bug in control tower processor

Upgrade

v1.6.1

Sep 3, 2024

IMPROVEMENTS

Improvements

  • Created new processor for extracting a message from singular log

Upgrade

v1.6.0

Jul 15, 2024

BUG FIXES

IMPROVEMENTS

Improvements

  • Increased DCSDK to 1.12.2 to 1.12.4

  • Removed Multithreading

  • Added a setup method

  • Removed Deduplication

  • Added debugging logging for using dynamic filenames to help with creating dynamic tags

Bug fixes

  • Fixed a bug where the message body was a string and caused a type error

  • Fixed a bug where client was not refreshed in time before acknowledging a message

Upgrade

v1.5.1

Jul 11, 2024

BUG FIXES

Bug fixes

Fixed dependency issue

Upgrade

v1.5.0

Jul 10, 2024

BUG FIXES

IMPROVEMENTS

Feature

  • Removed debug_md5 and made it default for all dictionary logs

  • Created a new vpc flow processor

  • Added new sender for relay in house + TLS

  • Added persistence functionality for gzip sending buffer

  • Added Automatic activation of gzip sending

Improvements

  • Updated docker image to 1.3.0

  • Updated DCDSK from 1.11.1 to 1.12.2

  • Fixed high vulnerability in Docker Image

  • Upgrade DevoSDK dependency to version v5.4.0

  • Fixed error in persistence system

  • Applied changes to make DCSDK compatible with MacOS

  • Added new sender for relay in house + TLS

  • Added persistence functionality for gzip sending buffer

  • Added Automatic activation of gzip sending

  • Improved behaviour when persistence fails

  • Upgraded DevoSDK dependency

  • Fixed console log encoding

  • Restructured python classes

  • Improved behaviour with non-utf8 characters

  • Decreased defaut size value for internal queues (Redis limitation, from 1GiB to 256MiB)

  • New persistence format/structure (compression in some cases)

  • Removed dmesg execution (It was invalid for docker execution)

Upgrade

v1.4.0

Jun 26, 2024

BUG FIXES

IMPROVEMENTS

FEATURES

Features

  • Implemented use of pulling events sent by event bridge

  • Added more debugging information to be added to events such as: Time the message was sent to queue, times it has been sent to the queue, the bucket, and file name

Bug fixes

  • Fixed an import dependency error

Improvements

  • Upped the visibility timeout to 1 hour by default

Upgrade

v1.3.2

Jun 17, 2024

BUG FIXES

Bug fixing

  • Fixed the initialization of the client credentials that was missing the token.

Upgrade

v1.3.1

Jun 14, 2024

BUG FIXES

Bug fixing

  • Fixed index out of range error in aws_sqs_fdr_large service

Upgrade

v1.3.0

Jun 10, 2024

FEATURES

Features

  • Fixed logging message saying the message wasn’t acked event though it was

  • Added use of 1-6 messages back in config

  • Added multithreading for downloading messages in parallel

  • Updated the aws_sqs_fdr_large service with a faster downloading method using ijson.

Upgrade

v1.2.3

May 29, 2024

FEATURES

Features

  • Updated to orjson for performance qualities.

Upgrade

v1.2.2

Apr 30, 2024

FEATURES

Features

  • Changed processors in handling of the log from str to json dumps

Upgrade

v1.2.1

Apr 9, 2024

FEATURES

Features

  • Added file filtering to the incapsula service

Upgrade

v1.2.0

Mar 22, 2024

IMPROVEMENTS

FEATURES

  • Updated to DCSDK 1.11.1

    • Added extra check for not valid message timestamps

    • Added extra check for improve the controlled stop

    •  Changed default number for connection retries (now 7)

    •  Fix for Devo connection retries

Upgrade

v1.1.3

Feb 23, 2024

IMPROVEMENTS

BUG FIXES

FEATURES

 

Bug fixes

  • Fixed bug in parquet log processing

  • Fixed the max number of messages and updated the message timeout in flight

  • Fixed the way access key and secret are used

Improvements

  • Updated to DCSDK 1.11.0

Features

  • Added feature to send md5 message to my.app table

  • Added RDS service to collector defs

Upgrade

v1.0.1

Jan 29, 2024

IMPROVEMENTS

BUG FIXES

Bug fixes

  • state file fixed

Improvements

  • using run method, instead of pull to enable long polling.

  • adding different types of encoding (latin-1)

  • update collector defs to be objects instead of arrays which was throwing off tagging, and record field mapping.

Upgrade

v1.0.0

Jan 19, 2024

INTIAL RELEASE

Released with DCSDK 1.10.2

Initial version