Network Planner Reporting and Layer Export Failures

Google Cloud Compute Infrastructure
1

Network planner is failing when trying to run reports and/or export coverage layers. Any prompt assistance would be highly appreciated! Text of error below:

Status
Failed

Finish time
Jun 20, 2024, 2:59 PM

Elapsed
3:14

Error
Flume pipeline failed: generic::permission_denied: RPC (mkpkgs) failed for cell ‘jb’: /BorgMaster.CreatePackage failed – CLIENT_VIOLATES_BUILD_HORIZON: The binary that sent the RPC is too old. It was built at timestamp 1701785779 and at changelist 587942956. See go/borg-build-horizon-policy for details and fixes. RPC had build_context 'build_changelist: 587942956 build_timestamp: 1701785779 build_target_name: “//spectrum/planner/reports:run_home_accessibility_report” ’ and was sent by role spectrum-planner-report-jobs. Binaries talking to Borgmaster must have been built stamped, not earlier than 2023-12-11 10:13:45 (1702318425), and after CL 0. Look in the INFO log for a dump of the failing protocol buffer. See go/borgcfg-logs if you need additional guidance how to find the logs. passed through: ==> "dist_proc/dax/workflow/worker_pool_manager/cluster_manager/borg_cluster_manager

2

Thanks for reporting this issue. It appears that the engineering team was able to identify and correct the problem - reports and export coverage should be working again.

3

Hi, Today I´m unable to export any coverage study, TIFF or KMZ, is any issue with the tool?

thanks

4

Hi Flizca25,

Yes, there is an issue which is currently being investigated in which reports fail, showing ‘An unknown error occurred’ in the report panel.

Home Accessibility reports and Deployments Stats reports may also be impacted.

Apologies for the inconvenience, I’ve made a note to update here when we have more information.

Kind regards,

Alex

5

Quick update before I log off for the weekend -

There is still an active issue which is being investigated. A partial fix was deployed - you might see reports fail on the first attempt, but succeed on the second attempt.

I’ll update here when we have more info.

Kind regards,

Alex

6

Thank you. I’m running new coverages, but the export is still not working, even on the second attempt.

7

Thanks for the update - I am still seeing the same behavior on my end as well.

The team is continuing to investigate this issue, I’ll update here when we have more information.

Kind regards,

Alex

8

Thank you, would the team have an ETR for this issue?

9

Hi Flizca,

I can’t provide an estimate at this time, but we are actively working on this - I’ll update here when we have more information. Apologies for the inconvenience this has caused.

Kind regards,

Alex

10

Good news! A fix has been deployed and all report types are expected to be working again.

Thanks for reaching out - please let us know if you find that this is not resolved for your projects.

Kind regards,

Alex

11

Thank you! I confirm that it is working well now.

12

Hello, I’m experiencing issues with exporting coverages again. Is there a problem with the tool?

13

Yes, as of this morning there is an issue impacting all report types except Autoplan reports. Apologies for the inconvenience, we are working on a fix but cannot yet provide a timeline.

I’ll update here when more info is available.

Kind regards,

Alex

14

We have deployed a fix, reports should be working again!

Thanks for reaching out,

Alex