According to research made by J. Birulés-Muntané1 and S. Soto-Faraco (10.1371/journal.pone.0158409), watching movies with subtitles can help us learn a new language more effectively. However, the traditional way of showing subtitles in YouTube or Netflix does not provide us the best way to check the meaning of new vocabulary nor understand complex slang and abbreviation. Therefore, we found out that if we display dual subtitles (the original subtitle of the video and the translated one), the learning curve immediately improves. In research conducted in Japan, the authors concluded that the participants who viewed the episode with dual subtitles did significantly better (http://callej.org/journal/22-3/Dizon-Thanyawatpokin2021.pdf). After understanding both the problem and the solution, we decided to create a platform for learning new languages with dual active transcripts. When you enter a YouTube URL or upload an MP4 file in our web application, the app will produce a web page where you can view the video and have a transcript running next to it in two different languages. We have accomplished this goal and successfully integrated OpenAI Whisper, GPT and Facebook's language model for the backend of the app. At first, we use Streamlit for the app, but it does not provide a transcript that automatically move with the audio timeline, also Streamlit does not give us the ability to design the user interface, so we create our own full stack application using Bootstrap, Flask, HTML, CSS and Javascript. Our business model is subscription-based and/or one-time purchase based on the usage. Our app isn’t just for language learners. It can also be used for writers, singers, YouTubers, or anyone who would like to make their content reach out to more people by adding different languages to their videos/audios. Due to the limitation of free hosting plan, we could not deploy the app on cloud for now but we have a simple website that you can have a quick look at what we are creating (https://phoenixwhisper.onrender.com/success/BzKtI9OfEpk/en).
News monitoring news allow observing and collecting key customer data directly from mentions and discussions about your company (or your client’s company). These discussions take place in social media comments, product review websites, blogs, podcasts, discussion forums, and media websites.
Join us for a hackathon where we will be using OpenAI Whisper to create innovative solutions! Whisper is a neural net that has been trained to approach human level robustness and accuracy for English speech recognition. We will be using this tool to create applications that can transcribe in multiple languages, as well as translate from those languages into English. This will be a great opportunity for you to learn more about speech processing and to create some useful applications!
🗓️ This will be a 7-day virtual hackathon from 16-23 December 💻 Build AI application with the latest large language model-powered technology by Cohere 💡 Get the chance to work with the best AI professionals in the industry and learn from them ✔️Entry level = 0. You’ve just started with AI? Are you an experienced Data Scientist? Or maybe you are a Designer or Business Developer? Join us! We need your domain knowledge! 🐱💻 Register now and let's get started! It’s free!
🚀💻 Be the first to build an AI App on Google's models! Hackathon on July 7-10. 🔬🌐 Try new Vertex AI features from Google Cloud Platform. 🤝🌍 Learn from AI leaders and connect with like-minded people. 🛠️📱 Build apps with the world's best AI tools! 💡🌍 Solve real-world problems with Generative AI models