Access to the raw server logs

Google Cloud Cloud Foundations & Onboarding
1

Hi.

We recently have had an issue where a lot of data that got posted through to our CRM via an api request didn’t get saved. Is there any chance we can get access to the logs of all HTTP post requests for example? The website is hosted via Google Cloud but so far we have had no luck getting the data from there - I can’t seem to find anywhere that stores 3rd party requests.

Any help would be greatly appreciated.

Thank you!

2

Hi @luukbrown ,

Welcome to Google Cloud Community!

It seems you’re dealing with a data loss issue in your CRM system. Although Google Cloud does not directly log third-party requests to your website, there are several options you can explore to potentially recover the missing data:

1. Check Your CRM’s Logs:

  • CRM-Specific Logs: Your CRM system likely has its own logging mechanisms. Check the CRM’s documentation for more information.

  • Database Logs: If your CRM uses a database, the database itself might have logs that record data insertion attempts.

2. Review Your API Integration:

  • API Documentation: Review this documentation for the API you’re using to interact with your CRM. It might provide guidance on error handling, logging, or debugging.

  • API Call Monitoring: If your API integration uses a third-party service or library, check if they offer any monitoring or logging features. These tools might capture details about API calls, including failures.

  1. Utilize Google Cloud Logging:
  • Cloud Logging for Your Website: If your website is hosted on Google Cloud, you can use Cloud Logging to capture logs from your website’s applications. While this won’t directly capture third-party requests, it might provide insights into your website’s behavior during the time of the data loss.
  • Cloud Logging for Your API: If you’re using Google Cloud Endpoints to manage your API, Cloud Logging can be configured to capture logs from your API calls. This could help identify any issues with your API’s handling of requests.
  1. Consider a Network Monitoring Tool:
  • Network Monitoring: A network monitoring tool, such as Google Cloud’s Network Intelligence Center, can capture network traffic data. This might help you identify if the requests were even reaching your CRM’s API endpoint.

Important Considerations:

  • Data Retention: Be aware that logs often have retention policies. If the data loss occurred a while ago, the relevant logs might have been deleted.
  • Security and Privacy: When accessing logs, be mindful of security and privacy considerations. Ensure you have the necessary permissions and are handling sensitive data responsibly.

I hope the above information is helpful.