About the Project

This is a privacy-first Google Meet note-taking extension that records meetings directly from your browser tab. It generates transcripts locally using Whisper, creates meeting summaries, and enables meeting-specific Q&A. It achieves this without requiring a separate bot account, an external meeting participant, or a paid transcription service.

Key Features

• Record Meetings Directly From Your Browser: Captures audio from your Google Meet tab and your microphone simultaneously, mixing both into a single recording. No meeting bot or participant admission is required.
• Local Whisper Transcription: Runs entirely on your machine using Hugging Face Transformers.js, meaning no API keys are needed and no audio is uploaded to third-party services. It supports transcription of all meeting participants.
• Live Captions: Provides real-time speech recognition for your microphone using the Chrome Web Speech API, offering instant feedback during meetings.
• Meeting Notes & Summaries: Automatically extracts important discussion points, generates concise notes, and highlights key decisions and action items.
• Ask Questions About Meetings: Allows you to query past meeting transcripts, retrieve relevant discussion segments, and search meeting content instantly.
• Privacy First: Audio remains on your device, transcription is processed locally, and there's no dependency on external transcription servers or cloud storage.

Technology Stack

• Frontend: HTML, CSS, JavaScript
• Browser APIs: Chrome Extension Manifest V3, MediaRecorder API, Web Audio API, SpeechRecognition API, Offscreen Documents API
• AI & NLP: Whisper, Transformers.js, TF-IDF Summarization
• Optional: Groq API, Llama 3 (for enhanced summaries and Q&A)

How It Works

The extension uses chrome.tabCapture to capture Google Meet tab audio and the microphone separately, merging them using AudioContext and MediaStreamDestination before recording. Live speech recognition is handled by the Chrome Web Speech API, and Whisper transcription is performed locally using Transformers.js.

Permissions

• tabCapture: To capture Google Meet tab audio.
• offscreen: To run background recording services.
• downloads: To save recordings locally.
• storage: To save transcripts and settings.
• activeTab: To access the active meeting tab.