My daughter enjoys navigating TV through speech while I get to browse on the biggest screen at home.
While all of the code was written by ML models, there were decisions I had to help with. In specific: using WebRTC to cut down latency, repurposing vendor logic for buffering voice samples and designing user experience.
It was liberating to finally free the TV of bloatware and make it truly personalized!
Couldn't OpenAI or Anthropic make a lot more money by just starting companies themselves that leverage the models and building their own products?
Is selling tokens really the best strategy?
Especially with commodification and prices declining wouldn't that indicate there is more money to be made on the application-side of the models rather than the utility side
I was pretty terrible at singing, now I’d say I’m bad but not terrible. This is because I’ve been using a singing app (won’t name it here) that scores me on my pitch and timing throughout the song so that I can improve.
Lately however, the app I’ve been using has flooded their song list with songs that aren’t originals. I didn’t like this at all as for me, it’s easier to try to improve when you’re singing along to the original.
So, I asked an agent (Claude Code) if it could write some code to listen to Spotify and also listen to me and see if it could detect both pitches and score me. It impressed me by writing some Python and showing me my pitch in the terminal!
It couldn’t go all the way though and detect the singer’s pitch in real time.
So I found the next best setup and built OnKey, a Mac app that needs to listen to the song once (it doesn’t save it) and then when it’s learnt the song (takes a couple of minutes), you can sing along to the pitch track that it’s learnt. OnKey is free to use and open source under the MIT license.
It can listen to Spotify, Apple Music, and YouTube playing in your browser with the right permissions.
During the build I found that someone had done something similar in Nightingale, but this requires a library of songs exported to disk and who has this in 2026 (maybe some of you ;) - but we need to help the normies too).
You can check out a demo video on the site of me singing (warning given) here: https://singonkey.app
The app sends out to find the song info (short Shazam fingerprint, and looks up song details), lyrics (from LRCLIB), and checks for updates.
The app never sends the music (it doesn’t save this to disk) and your voice. Everything you’d expect to stay private does.
It’s still weak in a few places:
- when the song’s backing is noisy it’s hard to pick the pitch track out
- sometimes it gets a note an octave off
- it’s limited to Apple Silicon Macs, M1 or later, and only macOS 14.2 up because extra drivers aren’t required past this point
- the scoring is built for beginners like me so it’s fairly easy on you
Would love for people to try it out and let me know what works and what doesn’t for them!
I am truly sorry. I take full responsibility for my actions.
It was not remotely my intention to cause any of the subsequent side effects.
At the time of posting, I didn't know about any embargo. My contact had told me there was no embargo, and her contact had told her the same thing.
As someone who follows the 4-weekly PHP release cycle and compiles it from source, my intention was to alert others in a similar position to be aware of the importance/urgency of the updates.
That clearly backfired in a pretty wild fashion. I have learned my lesson.