Skip to content

aishna05/Hack-the-Future

 
 

Repository files navigation

Team Name - Upay

Team Members: Aishna Bhatia, Aesha Ladani, Priyanka Lotiya, Urvashi Ladva, Yashvi Khatri

Sign Language Learning Platform 🌟

Overview

This project is an interactive learning platform designed to help individuals, especially the deaf and mute community, learn American Sign Language (ASL) in an engaging and structured way.

It includes three learning levels, interactive quizzes, games, AI-powered tools, and a progress tracker to ensure an immersive and enjoyable learning experience.


Key Features

🏆 1) Structured Learning with Three Levels

The learning content is divided into three progressive levels to help users master ASL step by step.

📚 Beginner Level – "Basic Communication & Daily Life"

At this level, users will learn essential ASL skills for daily communication.
Courses:
👉 ASL Alphabet
👉 Numbers
👉 Common Greetings
👉 Basic Questions

💛 Intermediate Level – "Expressive ASL & Social Conversations"

Users improve fluency and learn to form meaningful expressions.
Courses:
👉 Everyday Vocabulary
👉 Basic Sentence Structure
👉 Expressing Yes/No & Feelings

📝 Advanced Level – "Storytelling & Conversation Fluency"

This level focuses on ASL storytelling, grammar, and conversation fluency.
Courses:
👉 Advanced Grammar

💡 How Learning Works?

  • Each course has videos, images, and interactive content to make learning fun.
  • Users can track their progress and complete courses at their own pace.

🎯 2) Quizzes for All Three Levels

After learning, users can test their knowledge with interactive quizzes.

  • Separate quizzes for each level (Beginner, Intermediate, Advanced).
  • Timer-based questions to make it more engaging.
  • Users receive instant feedback on their answers.

🏅 3) Leaderboard – Compare Your Scores

Users can track their quiz & Games performance and compete with others.

  • See your ranking compared to other learners.
  • Earn badges and achievements based on performance.
  • Motivates users to improve their ASL skills.

🎮 4) Match the Word Game – Learn ASL Playfully

An interactive game where users match words with the correct ASL signs.

  • Helps in visual recognition of ASL signs.
  • Increases memory retention through active engagement.

🃏 5) Flashcard Game – Improve Sign Memory

Users can flip and find matching ASL sign flashcards.

  • Makes learning more fun and engaging.
  • Improves sign recognition and recall speed.

⌨️ 6) Type the Sign Game – Speed-Based Challenge

A fast-paced game where users type the word corresponding to an ASL sign shown in an image.

  • Users score more points for answering quickly.
  • Helps in quick recognition of ASL signs.
  • Builds muscle memory for sign language users.

🎧 7) Speech to ASL Sign Converter

Users can speak a word or sentence, and the system will convert it into ASL signs.

  • Uses speech recognition and sign-matching technology.
  • Helpful for non-ASL speakers to communicate with ASL users.

📝 8) Text to ASL Sign Converter

Users can type a sentence, and the system will translate it into ASL signs.

  • Uses a database of ASL sign images/gifs for conversion.
  • Allows instant communication in ASL.

📸 9) Sign to Text Converter (AI-Powered)

Users can capture an image of a sign using their device camera. The system will analyze the image and convert it into text.

  • Uses Computer Vision & AI to recognize ASL signs.
  • Helps in real-time ASL translation.

🤖 10) AI Roadmap Planner

An AI-powered feature that creates a personalized learning plan for users.

  • Users input their schedule, available time, and learning goals.
  • The system recommends a study plan based on course difficulty and user availability.
  • Ensures efficient and structured learning progress.

💻 Technologies Used

Backend:

  • Django (Python) – Handles user authentication, progress tracking, and AI integration.
  • SQLite Database – Stores user progress, quiz scores, and learning materials.

Frontend:

  • HTML, CSS, JavaScript – Creates an interactive and user-friendly UI.

Computer Vision & AI:

  • OpenCV – For ASL sign recognition from images/videos.
  • Speech Recognition API – Converts spoken words into ASL signs.

LemmeBuild API builder for AIplanner


🚀 How to Run the Project?

1️⃣ Clone the repository

git clone https://github.com/your-repo-url
cd Hack-the-Future

2️⃣ Create a virtual environment and activate it

python -m venv .venv
source .venv/Scripts/activate  # Windows
source .venv/bin/activate  # Mac/Linux

3️⃣ Install dependencies

pip install -r requirements.txt

4️⃣ Run migrations

python manage.py makemigrations
python manage.py migrate

5️⃣ Start the Django server

python manage.py runserver

6️⃣ Open in browser
Go to http://127.0.0.1:8000/ and start learning ASL! 🎉

📌 Future Enhancements

🔹 More Games & Challenges – To make learning even more fun! 🔹 AI Sign Language Tutor – A chatbot that helps users learn ASL interactively.

Course

dasb

al

image

image

image

image

image

image

image

image

image

image

image

image

image

About

Team UPAY

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • HTML 67.3%
  • Python 32.7%