## Inspiration 🌈

According to mentalhealth.uk, over 45% of children asked said they felt lonely 'often' or 'some of the time'.

That is way too high in our team's opinion.

At Teddy.ai, our inspiration is simple yet powerful: to ensure that no child or individual ever feels lonely. We believe in harnessing the potential of technology to create companionship, connection, and a brighter future for everyone. 🤗

## What It Does 🐻

Teddy.ai is not just a teddy bear; it's a gateway to a world of possibilities. 🌌

* It leverages the blockchain to introduce children to concepts like NFTs and FLOW tokens through fun and interactive experiences, while also leveraging Starknet to ensure privacy and scalability. 🧸🔗
* Teddy.ai is your child's snuggable best friend who understands them, rewards positive behavior, and ensures no child feels alone. 🎉
* With Teddy.ai, you can now seamlessly integrate your social media links and personal websites, allowing the bear to know all the details about its owner's life. It's like having a friend who truly understands you! 📱🌐

## How We Built It 🛠️

We built Teddy.ai with a combination of cutting-edge technologies:

* **Verbwire API**: Utilized for minting NFTs of precious memories in real-time. 🖼️
* **Flow Blockchain**: Integrated to enable transactions through speech, making it accessible for children. 🗣️
* **OpenAI Language Models (LLMs)**: Utilized OpenAI's language models for understanding and responding to users. 🤖
* **OpenAI Whisper**: Employed for Speech-to-Text (STT) functionality. 🎤
* **Beautiful Soup**: Used for web scraping to gather information. 🕸️
* **Elevenlabs**: Leveraged for Text-to-Speech (TTS) capabilities. 🔊
* **OpenCV**: Captured memories with a user's webcam. 📸
* **Sounddevice**: Recorded audio from interaction between the user and their teddy. 🎶
* **Starknet**: Leveraged Starknet mainnet to mint unique Teddy Bear NFTs for each teddy bear, immutably recording their owner on the blockchain.

## Challenges We Ran Into 🚧

During our journey, we faced several challenges, including:

* Working with Cadence as well as Flow Client Library for the first time. 💻
* Getting Flow transactions working in JavaScript and integrating them with our Python background. 🤯
* Integrating Starknet with the rest of our software given the intensive implementation necessary. 🧩

## Accomplishments That We're Proud Of 🏆

Our proudest accomplishments include:

* Successfully integrating web3 features seamlessly with our backend. 🌐
* Lowering the barrier so that even children can mint NFTs and send blockchain transactions. 🚀
* Integrating audio and video capture to make Teddy.ai a reality. 🎥🔊

## What We Learned 📚

First, working with Flow and Starknet for the first time was a significant learning experience for us, and it has enriched our understanding of blockchain technology. 🤓

In addition, integrating the frontend and backend proved to be quite the challenge. We were able to do so, but it took many hours. Thankfully, we were able to do so just in time for the hackathon submission deadline. 🕰️

Finally, we really love working with the new OpenAI Assistants and function calling APIs - we were able to streamline processes that would otherwise be incredibly complicated. 🤖

## What's Next For Teddy.ai 🚀

The journey has just begun! We envision Teddy.ai becoming a global symbol of companionship and learning. We'll continue to enhance its capabilities, expand its educational features, and explore new horizons in technology and education. Our mission remains clear: to ensure that no one ever feels alone, and that Teddy.ai is there to provide comfort, connection, and a bright future for all. 🌍💖

Join us on this exciting journey to redefine companionship and education with Teddy.ai! 🐻💡
## Inspiration

Our inspiration for TeddyTalk stems from the desire to create a magical and educational companion for children. In a world where technology is advancing rapidly, we wanted to apply the power of artificial intelligence to stimulate learning and communication in a friendly manner. Acknowledging that brain development is at its highest between ages 2 and 7, where access to technologies like AI and the internet is very limited, TeddyTalk provides a tool to enhance early education.

## What it does

TeddyTalk enables kids to chat with their teddy bear, enjoying storytelling answering questions, and playing games. A key feature is the parental control dashboard, allowing parents to regulate subjects, monitor conversations between their child and the toy, and access functionalities for a secure and personalized experience.

## How we built it

We constructed our system by implementing a central script on a Raspberry Pi, serving as the core component. This script manages voice recognition through the AssemblyAI API and utilizes the Mistral-7b Large Language Model (LLM) for text generation. The generated text is then forwarded to ElevenLabs for Text-to-Speech (TTS) voice generation.

Additionally, our system is designed to maintain a dynamic interaction with a parental dashboard, which is built using Vue.js. The dashboard facilitates communication with the Raspberry Pi by exchanging messages through an S3 AWS bucket. The main script on the Raspberry Pi uploads chat history and retrieves any instructions or updates from the parental dashboard, ensuring seamless integration and interaction between the user interface and the hardware.

## Challenges we ran into

Addressing privacy concerns and implementing robust security measures to safeguard the interactions and data within TeddyTalk, particularly considering its child-centric nature.

## Accomplishments that we're proud of

Achieving a user-friendly interface that makes TeddyTalk accessible and enjoyable for both children and parents

## What we learned

Understanding the crucial role of early years in shaping social and emotional development, alongside recognizing the rapid language development during this period.

## What's next for TeddyTalk

Exploring partnerships with educational experts and institutions to enhance TeddyTalk's educational content and align it with the latest developments in early childhood education.

Actively collecting and incorporating user feedback to refine and enhance TeddyTalk's features, addressing the specific needs and preferences of both children and parents.

Expanding TeddyTalk's compatibility with various smart devices, ensuring accessibility across different platforms and devices for a seamless user experience.
## Inspiration

Our biggest inspiration came from our grandparents, who often felt lonely and struggled to find help. Specifically, one of us have a grandpa with dementia. He lives alone and finds it hard to receive help since most of his relatives live far away and he has reduced motor skills. Knowing this, we were determined to create a product -- and a friend -- that would be able to help the elderly with their health while also being fun to be around! Ted makes this dream a reality, transforming lives and promoting better welfare.

## What it does

Ted is able to...

* be a little cutie pie
* chat with speaker, reactive movements based on conversation (waves at you when greeting, idle bobbing)
* read heart rate, determine health levels, provide help accordingly
* Drives towards a person in need through using the RC car, utilizing object detection and speech recognition
* dance to Michael Jackson

## How we built it

* popsicle sticks, cardboards, tons of hot glue etc.
* sacrifice of my fingers
* Play.HT and Claude 3.5 Sonnet
* YOLOv8
* AssemblyAI
* Selenium
* Arudino, servos, and many sound sensors to determine direction of speaker

## Challenges we ran into

Some challenges we ran into during development was making sure every part was secure. With limited materials, we found that materials would often shift or move out of place after a few test runs, which was frustrating to keep fixing. However, instead of trying the same techniques again, we persevered by trying new methods of appliances, which eventually led a successful solution!

Having 2 speech-to-text models open at the same time showed some issue (and I still didn't fix it yet...). Creating reactive movements was difficult too but achieved it through the use of keywords and a long list of preset moves.

## Accomplishments that we're proud of

* Fluid head and arm movements of Ted
* Very pretty design on the car, poster board
* Very snappy response times with realistic voice

## What we learned

* power of friendship
* don't be afraid to try new things!

## What's next for Ted

* integrating more features to enhance Ted's ability to aid peoples' needs --> ex. ability to measure blood pressure