Cloud Monitoring for Application Integration

Google Cloud Integration Services Knowledge Hub
1

To monitor your Application Integration traffic across different projects and track metrics like the total number of integrations, data processed, and total connections, you can leverage Google Cloud Monitoring. While these specific metrics aren’t directly available as a single dashboard in the platform, Cloud Monitoring provides the tools to create custom dashboards that meet your needs.

Here’s a breakdown of how you can achieve this:

Both Application Integration and Integration Connectors automatically export metrics to Cloud Monitoring. These metrics provide insights into the usage, performance, and health of your integrations and connectors.

  • Application Integration Metrics: These metrics help you understand the execution and performance of your integrations. Key metrics include:

    • Integration execution latency: Time taken for integrations to complete.
    • Data consumed by integration executions: Size of data processed by integrations (including input/output parameters and payloads).
    • Step execution count: Number of tasks or triggers executed within integrations.
    • Execution status: Status of integration executions (e.g., succeeded, failed, cancelled).
    • You can find a comprehensive list of Application Integration metrics (in Beta) in the monitoring documentation for Application Integration.

A user interface for a metrics explorer displays details for 'Integration execution count' within a selection panel, showing its name, description, metric path, resource types, unit, kind, value type, and launch stage.
A user interface for a metrics explorer displays details for 'Integration execution count' within a selection panel, showing its name, description, metric path, resource types, unit, kind, value type, and launch stage.1920×1125 81.2 KB

A user navigates a metrics explorer interface, selecting and viewing details for the "processed_bytes_count" metric
A user navigates a metrics explorer interface, selecting and viewing details for the "processed_bytes_count" metric1920×1120 86.4 KB

  • Integration Connectors Metrics: These metrics focus on the health and usage of your connections. Important metrics include:

    • Connection state: Current state of your connections (e.g., active, inactive).
    • Request count: Number of requests made through your connections.
    • Active nodes: Number of active nodes for your connections.
    • Connection status: Detailed status of individual connections.
    • Refer to the monitoring documentation for Integration Connectors for a complete list of available connector metrics.

'Metrics explorer' interface displaying various 'Connection' related metrics
'Metrics explorer' interface displaying various 'Connection' related metrics1920×1084 89.7 KB

You can monitor metrics from multiple Google Cloud projects within a single Cloud Monitoring dashboard. This feature simplifies monitoring for organizations that use multiple projects, allowing for a centralized view of operations. For more information : Google Cloud Blog post about multi-project Cloud Monitoring

Google Cloud Monitoring data can also be exported outside of GCP through several methods. The Cloud Monitoring REST API Documentation offers the most adaptable option, allowing programmatic retrieval for custom integrations. Pre-built integrations, like the Grafana plugin, simplify export and visualization. Additionally, logs-based metrics created within Cloud Logging can be exported via the Cloud Monitoring API for custom analysis.