Skip to content

Include test coverage numbers from cpancover #43

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
szabgab opened this issue Apr 4, 2023 · 12 comments
Open

Include test coverage numbers from cpancover #43

szabgab opened this issue Apr 4, 2023 · 12 comments

Comments

@szabgab
Copy link
Contributor

szabgab commented Apr 4, 2023

I've just added this to https://cpan-digger.perlmaven.com/ and it would be nice to add it here too.

my $cover = $mcpan->cover('Moo-2.23');
if (defined $cover->criteria) {
    $total =  $cover->criteria->{total};
}
@szabgab
Copy link
Contributor Author

szabgab commented Apr 5, 2023

And if you would like to implement this you might want to wait till this is closed: metacpan/MetaCPAN-Client#114

@davorg
Copy link
Collaborator

davorg commented Apr 5, 2023

Oh, that looks interesting. I think I read something recently about Coveralls.io going the way of Travis-CI and removing their free tier. It will be nice to have a replacement.

Two points though:

  • Running this for my CPAN modules, I see that only about half of them have the data. Do you know why some releases have it and some don't?
  • It would be good to be able to turn it into a real badge. Maybe I'll have a play on https://shields.io/ later.

@szabgab
Copy link
Contributor Author

szabgab commented Apr 5, 2023

Are the ones missing the data old releases? Maybe ones that have non-perl requirements?

AFAIK The data comes from http://cpancover.com/ so @pjcj might shed some light on why some (many?) are missing the results and what could be done to improve that?

@davorg
Copy link
Collaborator

davorg commented Apr 5, 2023

Actually, it might be the more recent releases that are missing data. I wonder how often cpancover runs.

@davorg
Copy link
Collaborator

davorg commented Apr 5, 2023

it might be the more recent releases that are missing data

That's wrong. The data is all over the place.

Release date Release Coverage
2020-12-06T10:06:00 App-Aphra-0.0.6 [Unknown]
2020-12-06T16:14:33 Ogg-Vorbis-Header-PurePerl-1.05 76.10
2020-12-21T10:37:32 Array-Compare-v3.0.8 97.49
2020-12-21T10:49:10 Plack-App-DirectoryIndex-0.0.3 [Unknown]
2020-12-22T09:49:29 SVG-TrafficLight-0.1.4 [Unknown]
2020-12-23T09:38:31 Template-Provider-Pandoc-0.0.4 [Unknown]
2021-01-04T08:51:40 AudioFile-Info-MP3-Tag-v1.6.3 [Unknown]
2021-01-04T09:01:59 AudioFile-Info-Ogg-Vorbis-Header-v1.8.3 [Unknown]
2021-01-04T13:27:42 AudioFile-Info-v2.0.2 94.94
2021-01-04T13:38:27 Ogg-Vorbis-Header-0.11 [Unknown]
2021-01-12T08:52:14 Genealogy-Relationship-0.0.5 [Unknown]
2021-01-12T08:56:18 SVG-ChristmasTree-0.0.5 [Unknown]
2021-01-13T10:36:17 Symbol-Approx-Sub-v3.1.3 98.67
2021-01-13T11:02:18 QMail-QueueHandler-2.0.4 [Unknown]
2021-01-14T11:55:50 Calendar-Simple-v2.0.1 99.24
2021-01-22T10:21:09 Genealogy-Ahnentafel-1.0.3 [Unknown]
2021-01-23T11:15:05 AudioFile-Info-Ogg-Vorbis-Header-PurePerl-v1.5.5 93.94
2021-01-23T11:51:02 Template-Plugin-AudioFile-Info-v2.0.2 100.00
2021-01-25T10:10:15 Tie-Hash-Cannabinol-v1.12.2 100.00
2021-01-25T10:14:20 Tie-Hash-FixedKeys-v1.13.2 100.00
2021-01-25T10:15:53 Tie-Hash-Regex-1.14 100.00
2021-01-25T10:22:53 Template-Plugin-RPM2-v1.3.4 [Unknown]
2021-01-28T15:19:07 Template-Plugin-XML-Feed-v1.0.3 [Unknown]
2021-03-02T14:09:33 AudioFile-Info-MP3-ID3Lib-v1.8.1 [Unknown]
2021-03-22T16:38:06 SVG-Timeline-Genealogy-0.0.5 [Unknown]
2021-04-15T16:27:27 Number-Fraction-v3.0.4 60.90
2021-05-13T16:44:57 App-CPANModuleSite-0.0.9 [Unknown]
2021-05-25T07:43:57 XML-Feed-0.63 [Unknown]
2021-06-06T15:49:57 MooX-Role-JSON_LD-1.0.1 [Unknown]
2021-07-17T14:11:29 Net-Songkick-v1.0.7 78.98
2022-02-15T20:48:41 Genealogy-AncestorChart-0.0.2 [Unknown]
2022-03-26T16:38:35 Plack-Middleware-DirIndex-1.01 97.44
2022-10-18T14:58:35 Feed-Find-0.13 88.55
2022-11-01T12:44:59 SVG-Timeline-0.1.3 [Unknown]
2023-01-13T10:52:30 Parse-RPM-Spec-v1.1.2 87.67
2023-03-01T16:12:24 Perlanet-v3.0.0 [Unknown]

@pjcj
Copy link

pjcj commented Apr 5, 2023

I'm not absolutely sure where all the data is coming from, but the first entry has coverage data on cpancover: http://cpancover.com/latest//App-Aphra-0.0.6/index.html so something seems wrong somewhere along the path.

For some modules cpancover doesn't have data, perhaps due to missing dependencies, the run taking too long, or bugs somewhere. You'll normally be able to get the full logs from the cpancover site as a gzipped text file to work out exactly (or roughly) what went wrong.

Newly uploaded modules are usually processed within some minutes, but it can be a few hours if lots of modules get uploaded together and especially if there are some releases which take a long time to run.

@davorg
Copy link
Collaborator

davorg commented Apr 5, 2023

App::Aphra has some particularly gnarly prerequisites, so it's highly likely that its test run just failed. I'll dig a bit further into the others.

Update: But, of course, that didn't happen because cpancover has the results.

@szabgab
Copy link
Contributor Author

szabgab commented Apr 5, 2023

@pjcj Where can we get those gzipped text files with the errors? I have never noticed them.

@szabgab
Copy link
Contributor Author

szabgab commented Apr 5, 2023

posted this issue: metacpan/metacpan-web#2884

@pjcj
Copy link

pjcj commented Apr 6, 2023

The logs are behind the pilcrow sign image which isn't immediately obvious I'm afraid unless you happen to be one of the first distributions on the page
image

@pjcj
Copy link

pjcj commented Apr 6, 2023

Homing in on the problem: metacpan/metacpan-web#2884 (comment)

@szabgab
Copy link
Contributor Author

szabgab commented Apr 6, 2023

Looking up what is a pilcrow...., oh I see. I completely missed that column. Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants