Nothing being pulled

[fredrikcoulter]

A week after the last time I used Pull from Duolingo, I've finished another unit and it's time to pull the latest new cards.

I successfully logged in, then it started pulling vocabulary. However, I got an error message that says "Expected value: line 1 column 1 (char 0)".

I've tried a couple times, getting the same result. I also thought that maybe this was due to a lack of cards to download, so I deleted some cards I suspended. Even after the cards were deleted, I still got the same error. (Don't worry about my studying; these were duplicate words that Duolingo listed twice.)

Has Duolingo screwed around with their system again? Or am I just having a bad day?

[KeivanAbdi]

I can confirm that I have been having the same issue since last week.

[fredrikcoulter]

I want to add that it appears to be a change on Duolingo's side. Duolingo Ninja (https://duolingoninja.com/) claims that something changed on March 9, which is right after I last successfully synced.

[JASchilz]

Hi folks, just wanted to check in to acknowledge this issue. I'll be able to take a look tomorrow!

…

On Fri, Mar 15, 2024, 10:02 PM eriksolg ***@***.***> wrote: Indeed they have changed something. https://www.duolingo.com/vocabulary/overview returns 404. — Reply to this email directly, view it on GitHub <#76 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABO2Q4C2753PQW44TPXWV7DYYPG6FAVCNFSM6AAAAABEW7XCT2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMBRGY3TOMRRGM> . You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

[JASchilz]

Alright! Thanks for reporting this, and I'm seeing the same things that you are.

Given the previous recent changes that made login difficult and now this change, I've removed the plugin from the Ankiweb plugin index. That said, I'll continue to try to maintain it at least for a while here in this repository for manual installation, if a solution comes up to this recent change. My feeling is that Duolingo is probably just not interested in maintaining a stable interface for third-party plugins and that that makes it a bit too unstable to support for the general Anki community.

It looks like the corresponding issue in the Duolingo library that I use in this plugin is KartikTalwar/Duolingo#139. I'll follow that to see if their community has a fix. Right now I'm kind of pessimistic that a fix will come out, but in any case it'll likely take a couple of weeks or more if one does come out. I'll continue to keep my eye out on this!

[gigajuwels]

@JASchilz a fix has come #141 :)

[JASchilz]

Roger! Will take a look this weekend. :)

[JASchilz]

Alright! I took a look. I'm still running into an error when I try integrating it, but my copy of the duolingo library has diverged from the Kartik's copy and so it seems likely the the cause is in that divergence.

I haven't had much time to debug this this weekend, but if you have this method working in the Kartik's project then it seems very likely that I can debug any issue in my copy without too much work, hopefully next weekend.

I'm doing my work in branch https://github.com/JASchilz/AnkiSyncDuolingo/tree/fix-from-gigajuwels if anyone else is wanting to take a look.

And thanks @gigajuwels both for the fix and for notifying us in this project. :)

[JASchilz]

Hey folks! Just wanted to let you know that I'm continuing to address this issue. I'm able to use @gigajuwels fix to retrieve vocabulary, however it's not quite a one-to-one replacement, so it might be a couple of weeks before I get it integrated and this issue closed.

[tomtaylz]

Hey there - I gave a go at fixing this - python is definitely not my forte so I could use some feedback. I also have never used Anki or your plugin in its previous working state so it was a fair bit of guess work and not sure how migration would go.

Not sure if this is something you still have on your plate -- My solution mostly works (when I hardcode a few things it works great on my account) but I still need to figure out the proper user to pass login API I took from your gitlab and I am looking at how to provide/set the learnLanguage. I also added the audio we get from the new vocab API to the Target as an audio player - although there maybe a better way to do this.

Hoping to get these things polished up in a few days if anything for my personal use but happy to open a PR and get feedback too if it's helpful.

[JASchilz]

Hey @tomtaylz , thanks for this and your work on moving this issue forward.

There's a couple of challenges here that I'm working with:

1. One is that I don't use this stuff myself regularly, so there's a big spin up time. I put a few hours today into cleaning up my fork of the duolingo library, with the hopes of making it really easy to maintain with auto documentation and doctests. And I think I've now got a good handle on how to get the necessary information out.
2. The second issue is that it doesn't look like there's any way to get the "gid" out of the vocabulary words--kind of a unique system identifier for each word--which I was using in this plugin to avoid importing the same word twice. I think I can come up with another new unique identifier, but as it will be different from the old one that might mean that there will be some challenge with duplicate cards when importing from whatever new version of the plugin I release the first time.

Gimme one more day to try to work this out, and then I might accept your help. :)

[JASchilz]

OK folks, I've created a release candidate which I can use to pull my words from Duolingo. Check out https://github.com/JASchilz/AnkiSyncDuolingo/releases/tag/3.0.0rc1 and the installation instructions there.

Perhaps the biggest disruptive change, in response to Duolingo's own changes to their service in March, is that the plugin is unable to de-duplicate any cards pulled using a previous version of this plugin. I figure that if this is a hurdle to jump, maybe users can share any strategies here for how to address this.

Also note that I'm unable to retrieve any new words until after you've completed a lesson. In other words, the plugin won't retrieve words after the first time that you encounter them, it will only retrieve words from lessons that you've completed.

I'm also creating an issue to help set expectations about my ability to maintain this plugin and invite any new maintainer who would like to take it on: https://github.com/JASchilz/AnkiSyncDuolingo/issues .

[tomtaylz]

Thanks @JASchilz I'll cherry pick some of your work to get my local branch in a better state too. I'm happy to help at least in the short term but full disclosure around EOY there's a likelihood I'll drop off more too (aggressively chasing a language right now to prepare for a trip) - I could create a PR for some cleanup and for my audio additions for feedback.

[JASchilz]

@tomtaylz seeing your changes would be appreciated.

I'd consider posting them more for posterity and not for hopes of getting them merged by me. In #78 I call out that I'm not able to give this project the full attention that I'd like to as owner, and invite a new maintainer. Having your code available could be interesting for that new maintainer, but I'm unlikely to be able to give it the diligence of a full review.