GenAI Video Short-form Generator

This repository is a sample generative AI video short-form generator application that uses Amazon Bedrock, Amazon Transcribe orchestrated with AWS serverless services. This sample application takes in long videos, understands it, and extracts and generate up to 15 short-form highlight video. It uses distant parts from the video to make more than 10 engaging, short-form content with titles and subtitles. The app also gives flexibility in choosing which frame to put in, and also the ability to edit titles and subtitles auto-generated by LLMs.

aws-shorts-demo.mp4

Architecture

Deployment

Prerequisites

1. Install AWS CLI & Set up AWS credentials

2. Install AWS CDK & CDK Bootstrap (for the first time)

3. Manage Model Access

Important

• The application uses Amazon Bedrock in the us-west-2 region. Please allow model access in us-west-2.
• The application only supports models from Anthropic Claude 3.0 and above (3.0 Haiku, 3.0 Sonnet, 3.0 Opus, 3.5 Sonnet).

Version 2 Update (10/31/24)

1. Revised and Improved Prompt for extracting and processing topics
2. Added feature to edit video in a more vertical ratio (3:4)
3. Improved Timeframe Matching accuracy after highlight extraction
4. Added "Upload with Subtitles" Option for faster processing
5. Added Claude 3.5 v2 as an option

Sandbox Deployment

1. Clone repository

git clone https://github.com/aws-samples/gen-ai-video-short-form-generator.git

2. Install dependencies

cd gen-ai-video-short-form-generator
npm install

3. Deploy cloud sandbox

npx ampx sandbox

Important

• It takes about 10 minutes to deploy.
• Do not terminate the sandbox environment while running the front-end application.

4. Run frontend app

npm run dev

Amplify Deployment

Create your own repository and follow Amplify deployment steps

Clean Up

Sandbox Environment

npx ampx sandbox delete

Important

You can verify whether all the resources have been deleted in the AWS CloudFormation console.

Amplify Development

To delete an Amplify project that has been deployed from the Amplify Development Step,

1. Go to your Amplify project console
2. Navigate to App Settings > General Settings > Delete app

Security

See CONTRIBUTING for more information.

Contacts

• Kihoon Kwon
• Sukwon Lee

License

This library is licensed under the MIT-0 License. See the LICENSE file.

Open Source Library

For detailed information about the open source libraries used in this application, please refer to the ATTRIBUTION file.