Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

USAGOV-2207: update cg logshipper version, add testing notes #20

Merged
merged 8 commits into from
Jan 29, 2025

Conversation

akf
Copy link
Member

@akf akf commented Jan 24, 2025

Jira Task

https://cm-jira.usa.gov/browse/USAGOV-2077

Description

Updated the checkout command for cg-logshipper to use the v1.0 tag.
Needed to test it, so I teased out some of the hard-coded values in the deployment scripts so I could use them to deploy to a test space, and added instructions for testing to the README.

Type of Changes

  • New Feature
  • Bugfix
  • Other

Testing Instructions

Please review the new testing hints in the README. Try them out if you feel so inclined!

Security Review

  • Adds/updates software (including a library or Drupal module)
  • Communication with external service
  • Changes permissions or workflow
  • Requires SSPP updates (fluent-bit version goes from 3.1 to 3.2)

Updates cg-logshipper, which in turn updates fluent-bit to version 3.2.4. I don't know of any security-related changes in those updates, though.

Reviewer Reminders

  • Reviewed code changes
  • Reviewed functionality
  • Security review complete or not required

Post PR Approval Instructions

Follow these steps as soon as you merge the new changes.

  1. Go to the USAGov Circle CI project.
  2. Find the commit of this pull request.
  3. Deploy the log-shipper. Watch the logs and make sure all went well.
  4. Update the Jira ticket by changing the ticket status to Done and add a comment.

@akf akf marked this pull request as ready for review January 24, 2025 22:36
@akf akf requested a review from arpage January 24, 2025 22:36
@@ -15,7 +15,7 @@ commands:
name: CloudGov Deploy
command: |
cf target -s $LOG_SHIPPER_SPACE
./bin/deploy-logshipper.sh << pipeline.number >>
./bin/deploy-logshipper.sh 3 << pipeline.number >>
Copy link
Contributor

@arpage arpage Jan 27, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@akf - I would leave a comment above deploy-logshipper.sh 3 explaining the 3. It looks like either a magic number (or some sort of redirect, with the circleci delimiters <<) until one reads the deploy-loggshipper.sh source code.

exit 1
fi

SERVICE_EXISTS=`cf service ${DRAIN_NAME} --guid`
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is just a style comment - the backticks `` for spawning a subshell is superseded by $( command )

Copy link
Contributor

@arpage arpage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi Amy - this looks good, and it worked for me (with the exception of NR traffic, which I expected not to work).

I am attaching a sample of the error messages I received, in case they are not NR related.

   2025-01-27T10:57:46.78-0500 [APP/PROC/WEB/SIDECAR/FLUENTBIT/0] ERR time="2025-01-27T15:57:46Z" level=info msg="Retryable error received. Will retry to send the logs (if there are attempts remaining, check Retry_Limit option)" error="Post \"https://gov-log-api.newrelic.com/log/v1\": dial tcp 162.247.241.138:443: connect: connection refused"
   2025-01-27T10:57:46.78-0500 [APP/PROC/WEB/SIDECAR/FLUENTBIT/0] ERR [2025/01/27 15:57:46] [error] [engine] chunk '13-1737993455.128500460.flb' cannot be retried: task_id=3, input=tcp.1 > output=newrelic.1

@akf akf requested a review from arpage January 27, 2025 23:17
Copy link
Contributor

@arpage arpage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@akf - build process / instructions yield a working logshipper example in my sandbox! Thanks!!

@akf akf merged commit 0d6460b into main Jan 29, 2025
1 check passed
@akf akf deleted the USAGOV-2207-update-cg-logshipper-version branch January 29, 2025 00:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants