z2

I agree. Take me to the spicy page.
It is currently Sat May 26, 2018 6:21 am

All times are UTC




Post new topic Reply to topic  [ 249 posts ]  Go to page Previous  1 ... 13, 14, 15, 16, 17
Author Message
 Post subject: Update
PostPosted: Wed Jan 24, 2018 1:30 am 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 189
After the successful beta (with sound!) of the HTML 5 version, I decided to focus on a few other areas. One area is the parts where the latest version is rough around the edges, such as the lack of ZIP file access and high score posting anomalies. I think I can create a limited JS handler for DEFLATE processing based on the "pako" library.

I also finally got started on a project I've wanted to do for some time, but delayed because I wasn't 100% sure how well it will work (I still don't). It's called ZZT Sound Plus. You should be able to feed waveform audio into the tool, and it will listen and pick out notes in the form of #PLAY statement strings.

If this seems kind of far-fetched, I agree. It is. But it is possible, because autotune is possible. To build it, I have to dive right into the highest of math to create and isolate peaks in a frequency distribution created from a Fourier transform. I probably lost everybody with that statement, so I'll just say this: it's complicated.


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Sat Feb 03, 2018 6:49 am 
Offline
I hope she made lotsa spaghetti!
User avatar

Joined: Sat May 20, 2006 2:58 am
Posts: 170
Location: LocacoLocacoL :LoL!
This sounds like a great idea for ZZT Ultra's programming progression, Can('t) wait to see what's in store in the future!!!

Happy 2018, ZZT forums!!!


Top
 Profile  
 
PostPosted: Mon Feb 12, 2018 2:24 am 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 189
That extremely far-fetched idea I had, which was the tool ZZT Sound Plus, has started to bear fruit. I just recorded a 2-minute song, fed the waveform audio into the tool, and then copied the note sequence it had spat out back into the Hall of Music.

The results were...like nails on a chalkboard, but you could actually recognize the song. I knew all along I'd need to do several things to clean up the audio output, because the tool, for all its capabilities, is kind of dumb. It doesn't know the song tempo, it doesn't know how to account for percussion, and it takes every frequency cycle it "hears" in the waveform extremely literally, erring on the side of more noise than you'd normally want.

Seriously, folks. This is a game changer. People had told me it's remarkable that I've been able to cover songs entirely by ear (no tabs, no sheet music), but with ZZT Sound Plus, a cover artist won't even need to have that ability!


Top
 Profile  
 
PostPosted: Thu Mar 08, 2018 11:00 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 189
Brief update. The results from the note-capturing tool so far are spotty, allowing you to understand the remnants of the song when played back through the Hall of Music. But there is a ton of noise that interferes with the output.

My goal is to find a way to quiet down, separate, or otherwise mitigate the noise in the Fast Fourier Transform output. Something something energy spectral density something integration something time averaging. That last sentence was completely intelligible, but you probably wouldn't have known, considering how cerebral this challenge is.

Kind of makes you wonder how our own ears do it, right? Work continues...


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Fri Mar 16, 2018 3:33 am 
Offline
fgsdfs
User avatar

Joined: Wed Mar 12, 2003 5:44 pm
Posts: 2432
Location: :noitacoL
I've always wanted a program to hum to and make music. FFTs are serious business, this is above and beyond zzt needs but neat all the same.

_________________
*POW* *CLANK* *PING*


Top
 Profile  
 
 Post subject: Window functions
PostPosted: Sat May 05, 2018 6:30 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 189
I'm trying to pick an ideal window function in ZZT Sound Plus. Vacillating between Hann and Hamming. No matter what the choice, though, artifacts keep popping up in the output.

But the output is sounding a lot better than it did at the start. Also, the problem of mysterious drops of prominent frequencies that had plagued the project from the start are now dealt with.

The tool is now in a good position to conduct note captures from recorded audio...but finding the ideal way to consolidate the notes has been tough. Consolidation is important, or else the whole capture sounds like a zillion 32nd notes played sequentially in a hot arpeggio mess. There are many ways to isolate captures to different voices, and so far none of my algorithms has been perfect.

I'm sorry...am I losing anyone? You can take a full year of calculus and still never hear about FFTs. It's the type of puzzle that drives a man to madness.


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Sun May 06, 2018 4:00 am 
Offline
I hope she made lotsa spaghetti!
User avatar

Joined: Sat May 20, 2006 2:58 am
Posts: 170
Location: LocacoLocacoL :LoL!
I'm still here, But I am still trying to get my account fixed and serviced on another site (Email needs swapping)... So I'm a little bit busy...


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Tue May 08, 2018 6:10 pm 
Offline
fgsdfs
User avatar

Joined: Wed Mar 12, 2003 5:44 pm
Posts: 2432
Location: :noitacoL
I don't know how relevant it is to what you're doing but this book seems like an essential for programmers doing FFTs: https://www.jjj.de/fxt/#fxtbook

_________________
*POW* *CLANK* *PING*


Top
 Profile  
 
PostPosted: Sun May 13, 2018 7:49 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 189
Finally! Here's a video I've made that shows how ZZT Sound Plus works.

https://www.youtube.com/watch?v=ld42KbwDjPY

There will be much more to the interface later. But the proof of concept has been nailed to the wall!


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 249 posts ]  Go to page Previous  1 ... 13, 14, 15, 16, 17

All times are UTC


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB® Forum Software © phpBB Group