Skip to content

[Bug][Github][Pull Requests Metrics] Pull requests metrics missing data - project_pr_metrics table not populated #8349

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
2 of 3 tasks
caioq opened this issue Mar 20, 2025 · 1 comment
Labels
component/plugins This issue or PR relates to plugins severity/p0 This bug blocks key user journey and function type/bug This issue is a bug

Comments

@caioq
Copy link
Contributor

caioq commented Mar 20, 2025

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

Since 2025-03-06, when using a GitHub connection with GitHub App and GraphQL, the table project_pr_metrics has not been receiving any data.
The pipeline completes with a success status, but no records are inserted into the table.

Blueprint configuration example:

{
  "plugin": "github_graphql",
  "subtasks": [
    "Collect Pull Requests",
    "Extract Pull Requests",
    "Collect Comments",
    "Extract Comments",
    "Collect PR Review Comments",
    "Extract PR Review Comments",
    "Collect Users",
    "Extract Users",
    "Enrich PR Issues",
    "Convert Repos",
    "Convert PR Commits",
    "Convert Pull Requests",
    "Convert PR Reviews",
    "Convert PR Labels",
    "Convert PR Issues",
    "Convert PR Comments",
    "Convert Reviews",
    "Convert Users"
  ],
  "options": {
    "connectionId": 1,
    "fullName": "XXX",
    "githubId": 999,
    "name": "XXX"
  }
},
{
  "plugin": "gitextractor",
  "subtasks": null,
  "options": {
    "connectionId": 1,
    "fullName": "XXX",
    "name": "XXX",
    "pluginName": "github",
    "proxy": "",
    "repoId": "github:GithubRepo:1:ZZZ",
    "url": "https://git:****************************************@github.com/XXX.git"
  }
}

What do you expect to happen

I expect the project_pr_metrics table to be populated with data when running the pipeline, as it was before March 6, 2025.

This data is crucial for tracking PR metrics, and the absence of records is impacting our ability to analyze GitHub contributions.

How to reproduce

  1. Configure a GitHub App connection with GraphQL.
  2. Run the pipeline with the configuration above.
  3. Check the project_pr_metrics table in the database.

Expected: Data should be inserted into project_pr_metrics.

Anything else

  • This issue occurs every time the pipeline runs since 2025-03-06.
  • I tried executing Re-Transform, but this only made the problem worse. It seems that the behavior applied to previous pull requests as well, increasing the number of PRs without metrics.
  • I also tested a new project running locally, and no records were inserted into the project_pr_metrics table.

Version

v1.0.1 and SHA: 8240c8d

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@caioq caioq added the type/bug This issue is a bug label Mar 20, 2025
@dosubot dosubot bot added component/plugins This issue or PR relates to plugins severity/p0 This bug blocks key user journey and function labels Mar 20, 2025
Copy link

dosubot bot commented Mar 20, 2025

I found a similar closed issue that might be relevant to your problem: [Bug][Project] project_mapping is empty when only GitHub data is collected. This issue was resolved by a pull request that addressed the problem of no entities being specified, which led to using all entities enabled by default. The issue was closed on December 6, 2023. You can view the details of the issue here.

While this specific issue was related to the project_mapping table, the resolution might provide insights into potential configuration or default settings that could affect data insertion into tables like project_pr_metrics. It might be worth checking if similar configuration adjustments could resolve your issue.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

@caioq caioq changed the title [Bug][Github][Pull Requests Metrics] Pull requests metrics are not being inserted [Bug][Github][Pull Requests Metrics] Pull requests metrics missing data - project_pr_metrics table not populated Mar 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/plugins This issue or PR relates to plugins severity/p0 This bug blocks key user journey and function type/bug This issue is a bug
Projects
None yet
Development

No branches or pull requests

1 participant