Replies: 1 comment
-
@celha imho you might be overthinking this. It should be simple to download files directly from s3 and then index them. I don't think we provide some out of the box component for this, but it shouldn't be hard. Best, |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi,
I'm currently wondering what the best practice is for loading files into a pipeline that aren't stored locally. For example, I have several files in a s3 bucket and want to load them directly from the cloud. I want to prevent downloading them first from s3 and then loading them into the pipeline.
Any ideas? Did I miss something?
Thank you in advance!
Beta Was this translation helpful? Give feedback.
All reactions