Nightly Testing Report

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/05/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/04
storage	failure
abtesting	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/06/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/05
storage	failure
crashlytics	failure
remoteconfig	failure
abtesting	failure
spm	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/07/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/06
core	in_process
crashlytics	failure
abtesting	failure

[ncooke3]

rerunning

[paulb777]

abtesting is failing because Xcode 16.3 is still in the rollout process. We could revert #14651 in the meantime

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/08/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/07
storage	failure
crashlytics	failure
vertexai	failure

[ncooke3]

rerunning

[paulb777]

Retrying vertexai after @andrewheard merged #14673

[paulb777]

Rerunning still runs on the old hash 135094a

[ncooke3]

Good find. We could consider adding manual dispatch to our workflows so they can be kicked off manually (like the zip one).

[andrewheard]

I kicked it off in https://github.com/firebase/firebase-ios-sdk/actions/runs/14336568287. I added a workflow_dispatch trigger in https://github.com/firebase/firebase-ios-sdk/actions/workflows/vertexai.yml for exactly that reason. I would definitely be in favour of adding them to the others too.

[ncooke3]

Awesome! I like having the manual dispatch as an option too. I'll send a PR adding it.

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/09/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/08
dynamiclinks	failure
storage	failure
messaging	in_process
firebasepod	failure
symbolcollision	failure
auth	failure
crashlytics	failure
remoteconfig	failure
database	failure
abtesting	failure
installations	failure
spm	failure
performance	failure
release	failure
prerelease	failure
archiving	failure
mlmodeldownloader	failure
combine	failure
firebase_app_check	failure
client_app	failure
vertexai	failure

[ncooke3]

This was due to my recent changes to move to internal imports

[andrewheard]

This was due to my recent changes to move to internal imports

@ncooke3 Some of these are also flakes (e.g., vertexai passed on re-run).

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/10/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/09
dynamiclinks	failure
storage	failure
firestore	failure
messaging	failure
crashlytics	failure
remoteconfig	failure
database	failure
abtesting	failure
inappmessaging	failure
installations	failure
performance	failure
appdistribution	in_process
prerelease	failure
combine	failure
firebase_app_check	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/11/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/10
dynamiclinks	failure
storage	failure
firestore	failure
messaging	failure
crashlytics	failure
remoteconfig	failure
abtesting	failure
inappmessaging	failure
installations	failure
spm	failure
performance	failure
appdistribution	in_process
prerelease	failure
combine	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/12/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/11
dynamiclinks	failure
storage	failure
firestore	failure
messaging	failure
remoteconfig	failure
abtesting	failure
inappmessaging	failure
installations	failure
spm	failure
performance	failure
appdistribution	in_process
combine	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/13/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/12
dynamiclinks	failure
storage	failure
firestore	failure
messaging	failure
crashlytics	failure
remoteconfig	failure
abtesting	failure
inappmessaging	failure
installations	failure
performance	failure
appdistribution	in_process
prerelease	failure
combine	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/14/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/13
dynamiclinks	failure
storage	failure
firestore	failure
messaging	failure
crashlytics	failure
remoteconfig	failure
abtesting	failure
installations	failure
performance	failure
appdistribution	in_process
prerelease	failure
combine	failure

[andrewheard]

Issue Triaging:

• abtesting
• appdistribution
• combine
• crashlytics
• dynamiclinks
  • quickstart-ftl-cron-only
• firestore
• installations
• messaging
  • quickstart-ftl-cron-only
  • messaging-cron-only: [Infra] Remove macos-13 from messaging-cron-only job #14713
• performance
• prerelease
• remoteconfig
• storage

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/15/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/14
dynamiclinks	failure
storage	failure
firestore	failure
messaging	failure
remoteconfig	failure
database	failure
abtesting	failure
inappmessaging	failure
installations	failure
performance	failure
appdistribution	in_process
prerelease	failure
combine	failure
vertexai	failure

[andrewheard]

Checkmark == success

Issue Triaging:

• abtesting
  • FTL failure only
• installations
  • FTL failure only
• messaging
  • FTL failure only
• performance
  • FTL failure only
• storage
  • FTL failure only
• dynamiclinks
  • FTL failure
  • Integration test failure (disabled via [Infra] Go build only for FDL tests #14721)
• appdistribution
  • Invalid macos-16 in workflow -- [Infra] Fix appdistribution workflow pod-lib-lint macos versions #14716
• combine
  • Applied Morgan's temporary fix from the Swift 6 branch: [Infra] Add --legacy flag to xcresulttool #14717 (running CI)
• database
  • This should also get fixed by Morgan's --legacy fix
• inappmessaging
  • This should also get fixed by Morgan's --legacy fix
• firestore
  • Was using Xcode 15. Fixed via [Infra] Update firestore.yml #14720
• prerelease
• remoteconfig
  • Set to use iOS 18.3.1 in [Infra] Temp. fix for RC's iOS integration tests #14729
  • Fixed linting warnings in [Infra] Fix remote config linting warnings #14731
• vertexai

[ncooke3]

FTL failures must be due to the the Xcode 16 changover. The app directory structure is different and there is a new __preview.dylib that is not being signed. It's explained in https://developer.apple.com/documentation/xcode/understanding-build-product-layout-changes

Will try building with ENABLE_DEBUG_DYLIB=NO to disable to creation of that dylib.

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/16/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/15
remoteconfig	failure
inappmessaging	failure
combine	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/17/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/16
crashlytics	failure
database	failure
inappmessaging	failure
prerelease	failure
combine	failure

[paulb777]

crashlytics fixed on rerun
prerelease fix in #14735

Rest need investigation

[andrewheard]

The rest are all due to needing to add --legacy to xcresulttool invocations. Need to find where else we are calling it since #14717 didn't resolve them all.

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/18/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/17
crashlytics	failure
inappmessaging	failure
prerelease	failure (now passing)
combine	failure
vertexai	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/19/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/18
inappmessaging	failure
combine	failure
vertexai	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/20/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/19
crashlytics	failure
inappmessaging	failure
combine	failure
vertexai	failure

[github-actions]

Nightly Testing Report

This issue(log) is generated at 04/21/2025 05:03 AM, fetching workflow runs triggered in the last 24 hrs.

Workflow	04/20
crashlytics	failure (now passing)
spm	failure (now passing)
vertexai	failure (known backend issue in integration tests)

[ncooke3]

spm rerun is green. waiting on csh

[andrewheard]

Everything is passing now except vertexai testapp-integration, which is failing due to a known (non-publicly facing) error.