Intended usage with docker #2044
Description
Checklist
- [ ?] I'm reporting a bug in Maigret functionality
- [ X] I've checked for similar bug reports including closed ones
- [ X] I've checked for pull requests that attempt to fix this bug
Description
Info about Maigret version you are running and environment :
docker run --rm soxoj/maigret --version
maigret 0.5.0a1
Socid-extractor: 0.0.27
Aiohttp: 3.12.14
Requests: 2.32.4
Python: 3.10.18
How to reproduce this bug (commandline options / conditions):
Search for any E-Mail address on all sites and look in the docker output from 361 lines 322 contain error.
Here an example:
Searching | | ▄▆█ 0/2669 [0%] in 0s (~0s,on 0: [checking.py:332] WARNING 09:39:18 Access denied error: 403 status code, use proxy/vpn
Searching |▏ | ▆█▆ 6/2669 [0%] in 0s (~3:0on 6: [checking.py:332] WARNING 09:39:18 Access denied error: 403 status code, use proxy/vpn
on 8: [checking.py:332] WARNING 09:39:18 Access denied error: 403 status code, use proxy/vpn
Searching |▎ | █▆▄ 14/2669 [1%] in 1s (~2:on 14: [checking.py:332] WARNING 09:39:18 Access denied error: 403 status code, use proxy/vpn
Searching |▎ | ▇▅▃ 14/2669 [1%] in 1s (~2:on 15: [checking.py:332] WARNING 09:39:18 Access denied error: 403 status code, use proxy/vpn
Searching |▎ | ▄▂▂ 16/2669 [1%] in 1s (~1:on 18: [checking.py:332] WARNING 09:39:18 Unexpected error: 400, message="Data after Connection: close:\n\n b'
nginx'\n ^", url='https://rev.mail.ru/forums/member.php?username=leo@priv-mail.me'
Searching |▍ | ▂▄▆ 25/2669 [1%] in 1s (~1:on 27: [checking.py:332] WARNING 09:39:18 Captcha error: Cloudflare
Searching |▍ | ▄▆█ 29/2669 [1%] in 1s (~1:on 30: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |▌ | ▅▇▇ 30/2669 [1%] in 1s (~1:on 34: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |▌ | ▇▇▅ 36/2669 [1%] in 1s (~1:on 37: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |▌ | █▆▄ 37/2669 [1%] in 1s (~1:on 37: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |▊ | ▃▁▃ 53/2669 [2%] in 1s (~1:on 54: [checking.py:332] WARNING 09:39:19 Unexpected error: 400, message="Data after
Connection: close:\n\n b'nginx'\n ^", url='https://ru.warface.com/forums/member.php?username=leo@priv-mail.me'
Searching |▉ | ▂▄▆ 59/2669 [2%] in 2s (~1:on 59: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
on 59: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |▉ | ▃▅▇ 59/2669 [2%] in 2s (~1:on 59: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |▉ | ▄▆█ 59/2669 [2%] in 2s (~1:on 60: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |█▏ | █▆▄ 71/2669 [3%] in 2s (~1:on 72: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
on 72: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |█▏ | ▆▄▂ 72/2669 [3%] in 2s (~1:on 73: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |█▏ | ▄▂▂ 76/2669 [3%] in 2s (~1:on 76: [checking.py:332] WARNING 09:39:19 Access denied error: 403 status code, use proxy/vpn
Searching |█▏ | ▃▁▃ 77/2669 [3%] in 2s (~1:on 78: [checking.py:332] WARNING 09:39:19 Connecting failure error: Cannot connect to host www.liveinternet.ru:443 ssl:default [Connect call failed ('0.0.0.0', 443)]
Searching |█▌ | ▂▄▆ 102/2669 [4%] in 2s (~1on 102: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▋ | ▄▆█ 105/2669 [4%] in 2s (~5on 105: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
on 105: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
on 105: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▋ | ▆█▆ 107/2669 [4%] in 2s (~5on 108: [checking.py:332] WARNING 09:39:20 Connecting failure error: Cannot connect to host leo%40priv-mail.me.tilda.ws:443 ssl:default [Misformatted domain name]
Searching |█▋ | ▆▄▂ 110/2669 [4%] in 3s (~5on 111: [checking.py:332] WARNING 09:39:20 Request blocked error: Cloudflare
Searching |█▋ | ▅▃▁ 111/2669 [4%] in 3s (~5on 111: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▊ | ▃▁▃ 113/2669 [4%] in 3s (~5on 113: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
on 113: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▊ | ▁▃▅ 115/2669 [4%] in 3s (~5on 115: [checking.py:332] WARNING 09:39:20 Connecting failure error: Cannot connect to host adultfriendfinder.com:443 ssl:default [Connect call failed ('0.0.0.0', 443)]
on 115: [checking.py:332] WARNING 09:39:20 Server error: 507 status code
Searching |█▊ | ▂▄▆ 115/2669 [4%] in 3s (~1on 117: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▊ | ▃▅▇ 117/2669 [4%] in 3s (~1on 118: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▊ | ▄▆█ 118/2669 [4%] in 3s (~1on 119: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▊ | ▆█▆ 120/2669 [4%] in 3s (~1on 123: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▉ | ▇▇▅ 123/2669 [5%] in 3s (~1on 124: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▉ | █▆▄ 124/2669 [5%] in 3s (~1on 125: [checking.py:332] WARNING 09:39:20 Access denied error: 403 status code, use proxy/vpn
Searching |█▉ | ▇▅▃ 125/2669 [5%] in 3s (~1on 125: [checking.py:332] WARNING 09:39:20 Site-specific error: Captcha detected
Searching |█▉ | ▆▄▂ 125/2669 [5%] in 3s (~1on 126: [checking.py:332] WARNING 09:39:20 Server error: 515 status code
Searching |█▉ | ▄▂▂ 128/2669 [5%] in 3s (~1on 128: [checking.py:332] WARNING 09:39:21 Site-specific error: Site error
Searching |█▉ | ▃▁▃ 128/2669 [5%] in 3s (~1on 129: [checking.py:332] WARNING 09:39:21 Captcha error: Cloudflare
Searching |█▉ | ▂▂▄ 129/2669 [5%] in 3s (~1on 129: [checking.py:332] WARNING 09:39:21 Access denied error: 403 status code, use proxy/vpn
Searching |█▉ | ▁▃▅ 129/2669 [5%] in 3s (~1on 132: [checking.py:332] WARNING 09:39:21 Access denied error: 403 status code, use proxy/vpn
Searching |██ | ▂▄▆ 132/2669 [5%] in 3s (~1on 132: [checking.py:332] WARNING 09:39:21 Connecting failure error: Cannot connect to host leo%40priv-mail.me.newgrounds.com:443 ssl:default [Misformatted domain name]
Searching |██ | ▅▇▇ 135/2669 [5%] in 3s (~1on 136: [checking.py:332] WARNING 09:39:21 Connecting failure error: Cannot connect to host www.zoomit.ir:443 ssl:default [DNS server returned general failure]
Searching |██ | █▆▄ 137/2669 [5%] in 3s (~1on 137: [checking.py:332] WARNING 09:39:21 Access denied error: 403 status code, use proxy/vpn
Searching |██ | ▇▅▃ 137/2669 [5%] in 3s (~1on 137: [checking.py:332] WARNING 09:39:21 Captcha error: Cloudflare
Searching |██ | ▆▄▂ 137/2669 [5%] in 3s (~1on 138: [checking.py:332] WARNING 09:39:21 Access denied error: 403 status code, use proxy/vpn
Searching |██▏ | ▃▁▃ 139/2669 [5%] in 4s (~1on 139: [checking.py:332] WARNING 09:39:21 Access denied error: 403 status code, use proxy/vpn
Searching |██▏ | ▂▂▄ 139/2669 [5%] in 4s (~1on 140: [checking.py:332] WARNING 09:39:21 Connecting failure error: Cannot connect to host leo%40priv-mail.me.booth.pm:443 ssl:default [Misformatted domain name]
Searching |██▏ | ▁▃▅ 140/2669 [5%] in 4s (~1on 140: [_internal.py:97] INFO 09:39:21 127.0.0.1 - - [19/Jul/2025 09:39:21] "GET /status/20250719_093916 HTTP/1.1" 200 -
Searching |██▏ | ▃▅▇ 141/2669 [5%] in 4s (~1on 142: [_internal.py:97] INFO 09:39:21 127.0.0.1 - - [19/Jul/2025 09:39:21] "GET /static/maigret.png HTTP/1.1" 304 -
Searching |██▏ | ▆█▆ 145/2669 [5%] in 4s (~1on 145: [checking.py:332] WARNING 09:39:21 Access denied error: 403 status code, use proxy/vpn
Searching |██▏ | ▇▇▅ 145/2669 [5%] in 4s (~1on 146: [checking.py:332] WARNING 09:39:21 Access denied error: 403 status code, use proxy/vpn
Searching |██▎ | █▆▄ 146/2669 [5%] in 4s (~1on 146: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▎ | ▇▅▃ 146/2669 [5%] in 4s (~1on 147: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▎ | ▄▂▂ 148/2669 [6%] in 4s (~1on 149: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▎ | ▁▃▅ 152/2669 [6%] in 4s (~1on 152: [checking.py:332] WARNING 09:39:22 Connecting failure error: Cannot connect to host mix.com:443 ssl:default [Connect call failed ('0.0.0.0', 443)]
Searching |██▎ | ▂▄▆ 152/2669 [6%] in 4s (~1on 153: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▎ | ▃▅▇ 153/2669 [6%] in 4s (~1on 154: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
on 154: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▎ | ▄▆█ 154/2669 [6%] in 4s (~1on 154: [checking.py:332] WARNING 09:39:22 Captcha error: Cloudflare
Searching |██▍ | ▆█▆ 155/2669 [6%] in 4s (~1on 156: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▍ | ▇▇▅ 156/2669 [6%] in 4s (~1on 156: [checking.py:332] WARNING 09:39:22 Connecting failure error: Cannot connect to host leo%40priv-mail.me.diary.ru:443 ssl:default [Misformatted domain name]
Searching |██▍ | █▆▄ 156/2669 [6%] in 5s (~1on 156: [checking.py:332] WARNING 09:39:22 Connecting failure error: Cannot connect to host leo%40priv-mail.me.contently.com:443 ssl:default [Misformatted domain name]
Searching |██▍ | ▇▅▃ 156/2669 [6%] in 5s (~1on 156: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▍ | ▄▂▂ 160/2669 [6%] in 5s (~1on 160: [checking.py:332] WARNING 09:39:22 Connecting failure error: Cannot connect to host joyreactor.cc:80 ssl:default [Connect call failed ('0.0.0.0', 80)]
Searching |██▍ | ▃▁▃ 160/2669 [6%] in 5s (~1on 160: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▌ | ▁▃▅ 163/2669 [6%] in 5s (~1on 164: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▌ | ▂▄▆ 164/2669 [6%] in 5s (~1on 164: [checking.py:332] WARNING 09:39:22 Site-specific error: Login required
Searching |██▋ | ▄▆█ 172/2669 [6%] in 5s (~1on 172: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▋ | ▅▇▇ 172/2669 [6%] in 5s (~1on 175: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▋ | ▆█▆ 175/2669 [7%] in 5s (~1on 176: [checking.py:332] WARNING 09:39:22 Access denied error: 403 status code, use proxy/vpn
Searching |██▋ | ▇▇▅ 176/2669 [7%] in 5s (~1on 177: [checking.py:332] WARNING 09:39:22 Site-specific error: Scraping protection
Searching |██▊ | ▆▄▂ 180/2669 [7%] in 5s (~1on 181: [checking.py:332] WARNING 09:39:22 Captcha error: Cloudflare
Searching |██▊ | ▄▂▂ 182/2669 [7%] in 5s (~1on 183: [checking.py:332] WARNING 09:39:23 Site-specific error: Cloudflare security protection detected
on 183: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▊ | ▁▃▅ 185/2669 [7%] in 5s (~1on 186: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▊ | ▂▄▆ 186/2669 [7%] in 5s (~1on 186: [checking.py:332] WARNING 09:39:23 Connecting failure error: Cannot connect to host mapi.yummly.com:443 ssl:default [DNS server returned general failure]
Searching |██▊ | ▃▅▇ 186/2669 [7%] in 5s (~1on 186: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▊ | ▄▆█ 186/2669 [7%] in 5s (~1on 186: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▊ | ▆█▆ 187/2669 [7%] in 5s (~1on 188: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▉ | ▇▇▅ 188/2669 [7%] in 5s (~1on 188: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▉ | ▇▅▃ 190/2669 [7%] in 5s (~1on 191: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▉ | ▆▄▂ 191/2669 [7%] in 5s (~1on 191: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |██▉ | ▄▂▂ 194/2669 [7%] in 6s (~1on 195: [checking.py:332] WARNING 09:39:23 Connecting failure error: Cannot connect to host leo%40priv-mail.me.listal.com:443 ssl:default [Misformatted domain name]
Searching |██▉ | ▃▁▃ 195/2669 [7%] in 6s (~1on 198: [checking.py:332] WARNING 09:39:23 Connecting failure error: Cannot connect to host leo%40priv-mail.me.carbonmade.com:443 ssl:default [Misformatted domain name]
Searching |███ | ▃▅▇ 200/2669 [7%] in 6s (~1on 200: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |███ | ▅▇▇ 201/2669 [8%] in 6s (~1on 201: [checking.py:332] WARNING 09:39:23 Server error: 502 status code
Searching |███ | ▆█▆ 201/2669 [8%] in 6s (~1on 201: [checking.py:332] WARNING 09:39:23 Access denied error: 403 status code, use proxy/vpn
Searching |███ | ▇▇▅ 201/2669 [8%] in 6s (~1on 201: [checking.py:332] WARNING 09:39:23 Server error: 500 status code
Searching |███ | ▇▅▃ 203/2669 [8%] in 6s (~1on 206: [checking.py:332] WARNING 09:39:23 Connecting failure error: Cannot connect to host leo%40priv-mail.me.basecamphq.com:443 ssl:default [Misformatted domain name]
Searching |████▎ | ▅▃▁ 283/2669 [11%] in 6s (~on 284: [checking.py:332] WARNING 09:39:24 Captcha error: Cloudflare
I used TOR and Mullvad VPN with the socks5 proxy and without.
Here it was often written use TOR but this does not seem to change anything.
Also when looking at the results for my own E-Mail adress:
And there are around 30-40 pages listed but i do not have a singel account on any of them and all pages lead to a page not found/exsitsting site
So my question is am i doing anything wrong?
Is this intended behaviour?