AI-Powered Kiosk Web App integration with Heygen SDK ( Proposal is mandatory)

via Freelancer ·

Budget / Salary$30–250
TypeFreelance project
LocationRemote
Posted1 hour ago
I need a front-end or full-stack developer who can turn my concept into a production-ready, public-facing kiosk application within 48 hours. The app will run on Vercel and be displayed on a large touch screen, so it must load fast, look polished at 1080p, and remain rock-solid even if left running for days.

Phase 1: Attractive & Engaging Public Front Screen (UI/UX)
The starting screen must be designed to actively attract passing public users to interact with the kiosk.

"Wow" Factor: High-end, modern, premium design. Use engaging animations (e.g., Framer Motion), glowing elements, or a looping background video to draw attention.

Clear Value Proposition: Large, inviting typography (e.g., "Ask me anything about [Company/Product]") and a highly visible, animated, touch-friendly "Tap to Start" button.

Kiosk Optimizations:

No page scrollbars; must fit perfectly within a 1080p viewport.

Implement the Screen Wake Lock API to prevent the screen from sleeping.

Idle Timeout: If inactive for 60 seconds, auto-end the session and return to the attractive Welcome Screen.

Phase 2: AI Avatar Integration & Transcript
Secure Token Fetching: On "Start", fetch a short-lived session token from the backend.

SDK Implementation: Initialize the LiveAvatarSession, attaching the video/audio stream to the UI.

Session Controls: A clear "End Session" button to stop the avatar and reset the kiosk.

Transcript UI: Real-time, scrolling text transcript of the user-AI conversation.

Phase 3: Secure Backend & Kiosk Lockdown
API Route: Create a Vercel Serverless Function (/api/get-access-token) that securely uses the LIVEAVATAR_API_KEY. The key must never be exposed in the client code.

Screen Lock & Prevent Exit: The app must enter Fullscreen Mode and attempt to re-enter if exited.

Password-Protected Exit: Implement a hidden gesture (e.g., tapping a corner 5 times) that prompts for a password/PIN to exit the kiosk app and access the OS.

Data Security: On session end or page unload, automatically clear all local storage, session storage, and cookies. No user data should persist after a restart.

OS-Level Lockdown Guide: Provide instructions for configuring the hardware (Windows Assigned Access, Android Kiosk Mode, or ChromeOS) to restrict user access to just this browser app.

Phase 4: Admin Reporting Dashboard
A secure, private route (e.g., /admin) to view usage metrics. This dashboard must be strictly separate from the public kiosk view.

Authentication: The dashboard must be password-protected (can use a simple basic auth or a secure login screen).

Metrics to Track:

Total number of sessions (Daily/Weekly/Monthly).

Average session duration.

Peak usage hours (time of day).

Total interactions (number of messages sent by users).

Implementation: Use a lightweight database (like Vercel KV or Supabase) to log these events securely on the backend when a session starts/ends.

5. Timeline & Milestones (Strict 2-Day Limit)
Day 1 (First 12-16 Hours): Vercel setup, backend API, database schema for tracking, and the highly engaging front-facing UI.

Day 2 (Remaining 24+ Hours): SDK integration, security lockdown (password exit, data clearing), Admin Dashboard UI, end-to-end testing, and final deployment.

6. Acceptance Criteria (Definition of Done)
The public Vercel URL loads a visually stunning, animated Welcome screen.

Tapping "Start" connects to the AI avatar; voice and video work flawlessly.

The kiosk cannot be easily exited; the hidden password gesture works.

The Admin Dashboard (/admin) is secure and accurately displays basic session counts and durations.

After a kiosk restart, no previous session data or API keys remain in the browser.

All source code is pushed to a GitHub repository and handed over.

7. Proposal Requirements (Instructions for Freelancers)
To be considered, your proposal must include:

A brief confirmation of your experience with React, Vercel Serverless, WebRTC, and UI/UX design.

A direct confirmation that you can deliver this within 48 hours.

Links to 1-2 past projects showing strong frontend design (animation/engagement).

Start your proposal with the word "KIOSK-AI" so I know you read this entire document.

Core experience
• React (or Next.js) for the client, with smooth touch interactions and an embedded LiveAvatar that greets visitors.
• Secure server-side coding for the admin dashboard—role-based log-in, rate limiting, and protection against kiosk tampering.
• Web Speech API, Whisper, or similar for real-time voice input and crystal-clear spoken answers so people with disabilities can use the station hands-free.
• OpenAI (or equivalent) integration to pull answers from two sources: (1) a fixed Q&A list I will supply and (2) dynamic entries my staff create inside the dashboard.

Key features that must be live by Saturday, November 14
1. Kiosk front end
– Single full-screen page with large buttons and text.
– Visitors press a mic icon, ask anything, and hear/see the answer aloud.
– Works offline-aware: if the network drops, a polite message should appear.

2. Admin dashboard
– Secure login for staff.
– CRUD interface to manage Q&A pairs, tag them, and push updates instantly.
– Analytics panel showing question logs, usage counts, and basic sentiment.

3. Deployment
– Hosted on my Vercel account under a custom domain.
– Environment variables and secrets stored with Vercel’s tooling.
– Lighthouse score 90+ on performance and accessibility.

Acceptance test
If I can boot the kiosk in Chrome kiosk mode, ask a question from the predefined list, receive a spoken reply, then add a brand-new answer in the dashboard and watch it go live without reloading, the project is complete.

Deliver the GitHub repo and Vercel link, plus a brief README describing setup, tech choices, and how to extend the assistant later. Time is tight, so clear daily check-ins and incremental pushes are essential.
css animation html web development full stack development api development webrtc next.js heygen vercel
Apply on Freelancer →

Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.