Skip to content

Reduce the amount of time it takes the SuiteCRM target to run #77

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jonathanmaw opened this issue Mar 31, 2023 · 1 comment
Open
Labels
enhancement New feature or request

Comments

@jonathanmaw
Copy link
Contributor

jonathanmaw commented Mar 31, 2023

It currently takes a long time to run TargetSuiteCRM when there are circa 100 users.
Part of this is that to fetch all the information about users, we need to:

  • Fetch all the User entries
  • Fetch all of each user's related E-mail addresses
  • Fetch all of each user's security groups

This must all be done at least once, but we don't necessarily have to do it all multiple times.
We also often have to re-fetch users, security groups and E-mail addresses after we've added them, since we need to address them by their ID.

  • Is it possible to retrieve the ID of a newly-created user?
    • I think so. The response data from a Create request might include the ID in the response. This might be sufficient to give us all the necessary information.
  • Do we need to fetch all the information about every user so often?
    • It's possible we can only re-fetch information about users we know have changed.
@jonathanmaw jonathanmaw changed the title SuiteCRM target takes a lot of time to run Reduce the amount of time it takes the SuiteCRM target to run Mar 31, 2023
@jonathanmaw jonathanmaw added the enhancement New feature or request label Mar 31, 2023
@thinkl33t
Copy link
Contributor

bumping up the api_page_size to 500 has helped a lot with this on the test CRM.

Not sure how ridiculous this is going to get when running against a real CRM though where there are tens of thousands of email addresses

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants