Created custom tagging off of record field mapping
Added INF0/DEBUG logging around most methods so users can see size and timing.
Bug Fixes
Fixed Dependency Issue.
Fixed control tower issue
Fixed Falcon Data Replicator Large where logs were taking over an hour to finish.
Recommended Version
v1.6.3
Status
colour
Red
title
Bug Fixes
Bug Fixes
Fixed Log Operations Bug
Added Backwards compatibility to control tower
Fixed Palo Alto Service for snappy decompression.
Upgrade
v1.6.2
Status
colour
Red
title
Bug Fixes
Bug Fixes
None type causing message processing to fail fdr_large, fixed.
Added default region to initialization of sts client to prevent needing environment variables in the green cluster.
Fixed bug in control tower processor
Upgrade
v1.6.1
Status
colour
Green
title
IMPROVEMENTS
Improvements
Created new processor for extracting a message from singular log
Upgrade
v1.6.0
Status
colour
Red
title
BUG FIXES
Status
colour
Green
title
IMPROVEMENTS
Improvements
Increased DCSDK to 1.12.2 to 1.12.4
Removed Multithreading
Added a setup method
Removed Deduplication
Added debugging logging for using dynamic filenames to help with creating dynamic tags
Bug fixes
Fixed a bug where the message body was a string and caused a type error.
Fixed a bug where client was not refreshed in time before acknowledging a message.
Upgrade
v1.5.1
Status
colour
Red
title
BUG FIXES
Bug fixes
Fixed dependency issue
Upgrade
v1.5.0
Status
colour
Red
title
BUG FIXES
Status
colour
Green
title
IMPROVEMENTS
Feature
Removed debug_md5 and made it default for all dictionary logs
Created a new vpc flow processor
Added new sender for relay in house + TLS
Added persistence functionality for gzip sending buffer
Added Automatic activation of gzip sending
Improvements
Updated docker image to 1.3.0
Updated DCDSK from 1.11.1 to 1.12.2
Fixed high vulnerability in Docker Image
Upgrade DevoSDK dependency to version v5.4.0
Fixed error in persistence system
Applied changes to make DCSDK compatible with MacOS
Added new sender for relay in house + TLS
Added persistence functionality for gzip sending buffer
Added Automatic activation of gzip sending
Improved behaviour when persistence fails
Upgraded DevoSDK dependency
Fixed console log encoding
Restructured python classes
Improved behaviour with non-utf8 characters
Decreased defaut size value for internal queues (Redis limitation, from 1GiB to 256MiB)
New persistence format/structure (compression in some cases)
Removed dmesg execution (It was invalid for docker execution)
Upgrade
v1.4.0
Status
colour
Red
title
BUG FIXES
Status
colour
Green
title
IMPROVEMENTS
Status
colour
Blue
title
FEATURES
Features
Implemented use of pulling events sent by event bridge
Added more debugging information to be added to events such as: Time the message was sent to queue, times it has been sent to the queue, the bucket, and file name.
Bug fixes
Fixed an import dependency error
Improvements
Upped the visibility timeout to 1 hour by default
Upgrade
v1.3.2
Status
colour
Red
title
BUG FIXES
Bug fixing
Fixed the initialization of the client credentials that was missing the token.
Upgrade
v1.3.1
Status
colour
Red
title
BUG FIXES
Bug fixing
Fixed index out of range error in aws_sqs_fdr_large service
Upgrade
v1.3.0
Status
colour
Blue
title
FEATURES
Features
Fixed logging message saying the message wasn’t acked event though it was
Added use of 1-6 messages back in config
Added multithreading for downloading messages in parallel
Updated the aws_sqs_fdr_large service with a faster downloading method using ijson.
Upgrade
v1.2.3
Status
colour
Blue
title
FEATURES
Features
Updated to orjson for performance qualities.
Upgrade
v1.2.2
Status
colour
Blue
title
FEATURES
Features
Changed processors in handling of the log from str to json dumps
Upgrade
v1.2.1
Status
colour
Blue
title
FEATURES
Features
Added file filtering to the incapsula service
Upgrade
v1.2.0
Status
colour
Green
title
IMPROVEMENTS
Status
colour
Blue
title
FEATURES
Updated to DCSDK 1.11.1
Added extra check for not valid message timestamps
Added extra check for improve the controlled stop
Changed default number for connection retries (now 7)
Fix for Devo connection retries
Upgrade
v1.1.3
Status
colour
Green
title
IMPROVEMENTS
Status
colour
Red
title
BUG FIXES
Status
colour
Blue
title
FEATURES
Bug fixes
Fixed bug in parquet log processing
Fixed the max number of messages and updated the message timeout in flight
Fixed the way access key and secret are used
Improvements
Updated to DCSDK 1.11.0
Features
Added feature to send md5 message to my.app table
Added RDS service to collector defs
Upgrade
v1.0.1
Status
colour
Green
title
IMPROVEMENTS
Status
colour
Red
title
BUG FIXES
Bug fixes
state file fixed
Improvements
using run method, instead of pull to enable long polling.
adding different types of encoding (latin-1)
update collector defs to be objects instead of arrays which was throwing off tagging, and record field mapping.
