2023-01-25T12:54:13.396 INFO MainProcess::MainThread -> Added "/devo-collector" directory to the Python path
2023-01-25T12:54:13.396 INFO MainProcess::MainThread -> Added "/devo-collector/config_internal" directory to the Python path
2023-01-25T12:54:13.396 INFO MainProcess::MainThread -> Added "/devo-collector/schemas" directory to the Python path
2023-01-25T12:54:13.396 INFO MainProcess::MainThread -> Production mode: True, execute only setup and exit: False, Python version: "3.9.10 (main, Jan 24 2023, 13:13:38) [GCC 9.4.0]", current dir: "/devo-collector", exists "config" dir: True, exists "config_internal" dir: True, exists "certs" dir: True, exists "schemas" dir: True, exists "credentials" dir: True
2023-01-25T12:54:13.419 INFO MainProcess::MainThread -> Loading configuration using the following files: {"full_config": "config.yaml", "job_config_loc": null, "collector_config_loc": null}
2023-01-25T12:54:13.419 INFO MainProcess::MainThread -> List of files in directory "/devo-collector/config": []
2023-01-25T12:54:13.419 INFO MainProcess::MainThread -> Using the default location for "job_config_loc" file: "/etc/devo/job/job_config.json"
2023-01-25T12:54:13.419 INFO MainProcess::MainThread -> Using the default location for "collector_config_loc" file: "/etc/devo/collector/collector_config.json"
2023-01-25T12:54:13.419 INFO MainProcess::MainThread -> Results of validation of config files parameters: {"config": "/devo-collector/config/config.yaml", "config_validated": False, "job_config_loc": "/etc/devo/job/job_config.json", "job_config_loc_default": True, "job_config_loc_validated": True, "collector_config_loc": "/etc/devo/collector/collector_config.json", "collector_config_loc_default": True, "collector_config_loc_validated": True}
2023-01-25T12:54:13.436 INFO MainProcess::MainThread -> Build time: "2023-01-24T17:01:02.855958522+0000", OS: "Linux-5.4.149-73.259.amzn2.x86_64-x86_64-with-glibc2.31", collector(name:version): "SOCRadar_collector:1.0.0", owner: "integrations_factory@devo.com", started at: "2023-01-25T12:54:13.433352Z"
2023-01-25T12:54:13.440 INFO MainProcess::MainThread -> Initialized all object from "MainProcess" process
2023-01-25T12:54:13.440 INFO MainProcess::MainThread -> OutputProcess - Starting thread (executing_period=120s)
2023-01-25T12:54:13.443 INFO MainProcess::MainThread -> InputProcess - Starting thread (executing_period=120s)
2023-01-25T12:54:13.444 INFO OutputProcess::MainThread -> Process started
2023-01-25T12:54:13.448 INFO MainProcess::MainThread -> Started all object from "MainProcess" process
2023-01-25T12:54:13.448 INFO InputProcess::MainThread -> Process Started
2023-01-25T12:54:13.449 INFO MainProcess::CollectorThread -> global_status: {"main_process": {"process_id": 7, "process_status": "sleeping", "thread_counter": 5, "thread_names": ["MainThread", "QueueFeederThread", "OutputControllerThread", "InputControllerThread", "CollectorThread"], "memory_info": {"rss": "51.41MiB", "vms": "360.62MiB", "shared": "14.38MiB", "text": "8.00KiB", "lib": "0.00B", "data": "76.79MiB", "dirty": "0.00B"}, "CollectorThread": {"running_flag": true, "status": "RUNNING(10)", "shutdown_timestamp": "None", "message_queues": {"standard": {"name": "standard_queue_multiprocessing", "max_size_in_messages": 10000, "max_size_in_mb": 1024, "max_wrap_size_in_items": 100, "current_size": 0, "put_lock": "<Lock(owner=None)>", "input_lock": "<multiprocessing.synchronize.Event object at 0x7f69f5458370>"}, "lookup": {"name": "lookup_queue_multiprocessing", "max_size_in_messages": 10000, "max_size_in_mb": 1024, "max_wrap_size_in_items": 100, "current_size": 0, "put_lock": "<Lock(owner=None)>", "input_lock": "<multiprocessing.synchronize.Event object at 0x7f69f5472fd0>"}, "internal": {"name": "internal_queue_multiprocessing", "max_size_in_messages": 10000, "max_size_in_mb": 1024, "max_wrap_size_in_items": 100, "current_size": 2, "put_lock": "<Lock(owner=SomeOtherProcess)>", "input_lock": "<multiprocessing.synchronize.Event object at 0x7f69f54ca9a0>"}}, "controllers": {"InputControllerThread": {"running_flag": true, "status": "RUNNING(10)", "underlying_process": {"process_id": 12, "process_status": "running", "num_threads": 2, "memory_info": {"rss": "41.45MiB", "vms": "212.62MiB", "shared": "4.45MiB", "text": "8.00KiB", "lib": "0.00B", "data": "56.54MiB", "dirty": "0.00B"}, "exit_code": null}}, "OutputControllerThread": {"running_flag": true, "status": "RUNNING(10)", "underlying_process": {"process_id": 10, "process_status": "running", "num_threads": 1, "memory_info": {"rss": "40.77MiB", "vms": "138.61MiB", "shared": "3.79MiB", "text": "8.00KiB", "lib": "0.00B", "data": "46.41MiB", "dirty": "0.00B"}, "exit_code": null}}}}}}
2023-01-25T12:54:13.451 INFO MainProcess::CollectorThread -> environment_status: {"cpu_count": 8, "cpu_usage": "1:3.09, 5:3.26, 15:3.67, ", "virtual_memory": {"total": "62.03GiB", "available": "56.24GiB", "percent": 9.3, "used": "5.50GiB", "free": "43.61GiB", "active": "4.72GiB", "inactive": "11.08GiB", "buffers": "2.64MiB", "cached": "12.92GiB", "shared": "9.35MiB", "slab": "2.19GiB"}, "disk_usage": {"/dev/termination-log": 5.3, "/etc/hosts": 5.3, "/etc/resolv.conf": 5.3, "/etc/hostname": 5.3, "/etc/devo/collector": 5.3}, "processes_info": [{"pid": 1, "ppid": 0, "process_name": "sh", "process_cmd": "/bin/sh -c devo-collector --config ${CONFIG_FILE:-config.yaml} --prod-mode", "memory_usage": {"rss": "596.00KiB", "vms": "2.55MiB", "shared": "528.00KiB", "text": "96.00KiB", "lib": "0.00B", "data": "316.00KiB", "dirty": "0.00B"}}, {"pid": 7, "ppid": 1, "process_name": "devo-collector", "process_cmd": "/usr/local/bin/python /usr/local/bin/devo-collector --config config.yaml --prod-mode", "memory_usage": {"rss": "51.57MiB", "vms": "360.62MiB", "shared": "14.49MiB", "text": "8.00KiB", "lib": "0.00B", "data": "76.79MiB", "dirty": "0.00B"}}, {"pid": 10, "ppid": 7, "process_name": "devo-collector", "process_cmd": "/usr/local/bin/python /usr/local/bin/devo-collector --config config.yaml --prod-mode", "memory_usage": {"rss": "40.77MiB", "vms": "138.61MiB", "shared": "3.79MiB", "text": "8.00KiB", "lib": "0.00B", "data": "46.41MiB", "dirty": "0.00B"}}, {"pid": 12, "ppid": 7, "process_name": "devo-collector", "process_cmd": "/usr/local/bin/python /usr/local/bin/devo-collector --config config.yaml --prod-mode", "memory_usage": {"rss": "41.46MiB", "vms": "212.62MiB", "shared": "4.45MiB", "text": "8.00KiB", "lib": "0.00B", "data": "56.54MiB", "dirty": "0.00B"}}]}
2023-01-25T12:54:13.493 WARNING OutputProcess::MainThread -> DevoSender::_validate_kwargs_for_method__init__ -> The <address> is not a standard address (collector-eu.devo.io, collector-us.devo.io): collector-ap.devo.io
2023-01-25T12:54:13.498 WARNING OutputProcess::MainThread -> DevoSender::_validate_kwargs_for_method__init__ -> The <address> is not a standard address (collector-eu.devo.io, collector-us.devo.io): collector-ap.devo.io
2023-01-25T12:54:13.502 WARNING OutputProcess::MainThread -> DevoSender::_validate_kwargs_for_method__init__ -> The <address> is not a standard address (collector-eu.devo.io, collector-us.devo.io): collector-ap.devo.io
2023-01-25T12:54:13.503 INFO OutputProcess::MainThread -> DevoSender(standard_senders,devo_sender_0) -> Starting thread
2023-01-25T12:54:13.504 INFO OutputProcess::MainThread -> DevoSenderManagerMonitor(standard_senders,relay_0) -> Starting thread (every 300 seconds)
2023-01-25T12:54:13.504 INFO OutputProcess::MainThread -> DevoSenderManager(standard_senders,manager,relay_0) -> Starting thread
2023-01-25T12:54:13.504 INFO OutputProcess::MainThread -> DevoSender(lookup_senders,devo_sender_0) -> Starting thread
2023-01-25T12:54:13.505 INFO OutputProcess::MainThread -> DevoSenderManagerMonitor(lookup_senders,relay_0) -> Starting thread (every 300 seconds)
2023-01-25T12:54:13.505 INFO OutputProcess::MainThread -> DevoSenderManager(lookup_senders,manager,relay_0) -> Starting thread
2023-01-25T12:54:13.505 INFO OutputProcess::MainThread -> DevoSender(internal_senders,devo_sender_0) -> Starting thread
2023-01-25T12:54:13.506 INFO OutputProcess::MainThread -> DevoSenderManagerMonitor(internal_senders,relay_0) -> Starting thread (every 300 seconds)
2023-01-25T12:54:13.506 INFO OutputProcess::MainThread -> DevoSenderManager(internal_senders,manager,relay_0) -> Starting thread
2023-01-25T12:54:13.526 INFO InputProcess::MainThread -> InputThread(socradar,17812) - Starting thread (execution_period=60s)
2023-01-25T12:54:13.526 INFO InputProcess::MainThread -> ServiceThread(socradar,17812,incidents,predefined) - Starting thread (execution_period=60s)
2023-01-25T12:54:13.526 INFO InputProcess::MainThread -> SOCRadarPullerSetup(SOCRadar_collector,socradar#17812,incidents#predefined) -> Starting thread
2023-01-25T12:54:13.527 INFO InputProcess::MainThread -> SOCRadarPuller(socradar,17812,incidents,predefined) - Starting thread