Skip to content

Conversation

ParthaI
Copy link
Contributor

@ParthaI ParthaI commented Sep 11, 2025

Example query results

Results
> select event_name, event_id, event_time from aws_cloudtrail_log
+-------------------------------------------+--------------------------------------+---------------------+
| event_name                                | event_id                             | event_time          |
+-------------------------------------------+--------------------------------------+---------------------+
| AssumeRole                                | 026680c3-17de-3410-8ea0-ac3c81101a8f | 2025-09-04 14:09:35 |
| AssumeRole                                | 51687b87-b629-3543-9e23-b0f956517bba | 2025-09-04 18:43:49 |
| GetBucketAcl                              | f46b463e-2f8d-36b7-8f1f-e69d180eac4a | 2025-09-04 09:26:52 |
| AssumeRole                                | aea397f0-6ead-3cb5-bed1-54bcad91b238 | 2025-09-04 09:27:04 |
| GetAccessKeyLastUsed                      | ae138198-0a8d-4c55-ac63-395fe4c92634 | 2025-09-04 04:47:34 |
| AssumeRole                                | d1b37c20-2984-334e-b23e-5c2a695617f5 | 2025-09-04 04:48:33 |
| AssumeRole                                | 0154734a-3bab-36b6-9445-53af750366a8 | 2025-09-04 04:48:49 |

@ParthaI ParthaI requested a review from Copilot September 11, 2025 05:52
@ParthaI ParthaI self-assigned this Sep 11, 2025
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR refactors the CloudWatch log group source to process events incrementally as they are fetched from the API, rather than collecting all events first and then processing them. This approach improves memory efficiency and reduces latency by starting event processing immediately.

  • Introduces a new processLogEvents method to handle event processing logic
  • Modifies filterLogEvents to process events page-by-page instead of accumulating all events
  • Moves event processing logic from the main collection loop into dedicated processing function

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@ParthaI ParthaI requested a review from misraved September 11, 2025 07:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant