z2

I agree. Take me to the spicy page.
It is currently Fri Aug 17, 2018 3:17 pm

All times are UTC




Post new topic Reply to topic  [ 254 posts ]  Go to page Previous  1 ... 13, 14, 15, 16, 17
Author Message
 Post subject: Update
PostPosted: Wed Jan 24, 2018 1:30 am 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 191
After the successful beta (with sound!) of the HTML 5 version, I decided to focus on a few other areas. One area is the parts where the latest version is rough around the edges, such as the lack of ZIP file access and high score posting anomalies. I think I can create a limited JS handler for DEFLATE processing based on the "pako" library.

I also finally got started on a project I've wanted to do for some time, but delayed because I wasn't 100% sure how well it will work (I still don't). It's called ZZT Sound Plus. You should be able to feed waveform audio into the tool, and it will listen and pick out notes in the form of #PLAY statement strings.

If this seems kind of far-fetched, I agree. It is. But it is possible, because autotune is possible. To build it, I have to dive right into the highest of math to create and isolate peaks in a frequency distribution created from a Fourier transform. I probably lost everybody with that statement, so I'll just say this: it's complicated.


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Sat Feb 03, 2018 6:49 am 
Offline
I hope she made lotsa spaghetti!
User avatar

Joined: Sat May 20, 2006 2:58 am
Posts: 173
Location: LocacoLocacoL :LoL!
This sounds like a great idea for ZZT Ultra's programming progression, Can('t) wait to see what's in store in the future!!!

Happy 2018, ZZT forums!!!


Top
 Profile  
 
PostPosted: Mon Feb 12, 2018 2:24 am 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 191
That extremely far-fetched idea I had, which was the tool ZZT Sound Plus, has started to bear fruit. I just recorded a 2-minute song, fed the waveform audio into the tool, and then copied the note sequence it had spat out back into the Hall of Music.

The results were...like nails on a chalkboard, but you could actually recognize the song. I knew all along I'd need to do several things to clean up the audio output, because the tool, for all its capabilities, is kind of dumb. It doesn't know the song tempo, it doesn't know how to account for percussion, and it takes every frequency cycle it "hears" in the waveform extremely literally, erring on the side of more noise than you'd normally want.

Seriously, folks. This is a game changer. People had told me it's remarkable that I've been able to cover songs entirely by ear (no tabs, no sheet music), but with ZZT Sound Plus, a cover artist won't even need to have that ability!


Top
 Profile  
 
PostPosted: Thu Mar 08, 2018 11:00 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 191
Brief update. The results from the note-capturing tool so far are spotty, allowing you to understand the remnants of the song when played back through the Hall of Music. But there is a ton of noise that interferes with the output.

My goal is to find a way to quiet down, separate, or otherwise mitigate the noise in the Fast Fourier Transform output. Something something energy spectral density something integration something time averaging. That last sentence was completely intelligible, but you probably wouldn't have known, considering how cerebral this challenge is.

Kind of makes you wonder how our own ears do it, right? Work continues...


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Fri Mar 16, 2018 3:33 am 
Offline
fgsdfs
User avatar

Joined: Wed Mar 12, 2003 5:44 pm
Posts: 2434
Location: :noitacoL
I've always wanted a program to hum to and make music. FFTs are serious business, this is above and beyond zzt needs but neat all the same.

_________________
*POW* *CLANK* *PING*


Top
 Profile  
 
 Post subject: Window functions
PostPosted: Sat May 05, 2018 6:30 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 191
I'm trying to pick an ideal window function in ZZT Sound Plus. Vacillating between Hann and Hamming. No matter what the choice, though, artifacts keep popping up in the output.

But the output is sounding a lot better than it did at the start. Also, the problem of mysterious drops of prominent frequencies that had plagued the project from the start are now dealt with.

The tool is now in a good position to conduct note captures from recorded audio...but finding the ideal way to consolidate the notes has been tough. Consolidation is important, or else the whole capture sounds like a zillion 32nd notes played sequentially in a hot arpeggio mess. There are many ways to isolate captures to different voices, and so far none of my algorithms has been perfect.

I'm sorry...am I losing anyone? You can take a full year of calculus and still never hear about FFTs. It's the type of puzzle that drives a man to madness.


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Sun May 06, 2018 4:00 am 
Offline
I hope she made lotsa spaghetti!
User avatar

Joined: Sat May 20, 2006 2:58 am
Posts: 173
Location: LocacoLocacoL :LoL!
I'm still here, But I am still trying to get my account fixed and serviced on another site (Email needs swapping)... So I'm a little bit busy...


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Tue May 08, 2018 6:10 pm 
Offline
fgsdfs
User avatar

Joined: Wed Mar 12, 2003 5:44 pm
Posts: 2434
Location: :noitacoL
I don't know how relevant it is to what you're doing but this book seems like an essential for programmers doing FFTs: https://www.jjj.de/fxt/#fxtbook

_________________
*POW* *CLANK* *PING*


Top
 Profile  
 
PostPosted: Sun May 13, 2018 7:49 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 191
Finally! Here's a video I've made that shows how ZZT Sound Plus works.

https://www.youtube.com/watch?v=ld42KbwDjPY

There will be much more to the interface later. But the proof of concept has been nailed to the wall!


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Mon Jun 18, 2018 9:02 am 
Offline
I hope she made lotsa spaghetti!
User avatar

Joined: Sat May 20, 2006 2:58 am
Posts: 173
Location: LocacoLocacoL :LoL!
Shockwave Flash is appearently on the fritz again... Even though HTML5 support is being worked on...

This time, Keystrokes for CTRL/SHIFT/ALT cannot be pressed along with the other (Letter, Numerical, etc.) keys because they create bad/invalid symbols every time...

And yes, I've tried reinstalling ZZT Ultra and Adobe Flash Runtime to get things running with no success...

I am using the latest Firefox browser as well...


Top
 Profile  
 
PostPosted: Sun Jun 24, 2018 6:56 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 191
Hmm...I figured the day was going to come where it becomes increasingly harder to require Flash in a browser. You can install it or activate it on any browser you want, but it's no longer as automatic as it used to be. Very much a manual thing, anymore.

I guess this means HTML 5 is more or less the future of this project now. ZZT Sound Plus is still under development, but I really should get off my rear end and release a more official, non-beta version of the HTML 5 build. It still lacks features like ZIP file support, but this was never a mandatory feature, in all honesty.

I should also build an HTML 5 version of the Hall of Music. Thankfully, this isn't going to be hard, now that I know how to program the exact same sound in HTML 5 as in Flash.

About ZZT Sound Plus: this tool is going to be dynamite. Here's an example of an output fragment for the System Shock Cyberspace theme. Figured it was fitting, hacking a song for a game all about a hacker.


Attachments:
File comment: System Shock Cyberspace Theme
zzt_sp_auto_con_result.png
zzt_sp_auto_con_result.png [ 5.87 KiB | Viewed 311 times ]
Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Wed Jul 11, 2018 3:43 pm 
Offline
the Gargoyle.
User avatar

Joined: Tue Jul 25, 2006 10:02 am
Posts: 606
That is *really heckin' cool*.


Top
 Profile  
 
PostPosted: Tue Jul 31, 2018 10:05 pm 
Offline
Official Clamp School Defender
User avatar

Joined: Tue Nov 18, 2014 4:57 am
Posts: 191
The ZZT Sound Plus tool is nearing completion. The one challenge I have left is the highly subjective art of figuring out the ideal way to chain together adjacent 8th, 16th, 32nd, and 64th notes in a measure in generated sheet music.

It's become clear that this invention will have implications that go well beyond the scope of anything ZZT-related. Already I'm thinking of creating sheet music songbooks that can't be obtained any other way.

The original motivation, though, still stands. You would be able to create a "ZZT" version of any recorded song on the cheap.

Just a bit longer, folks!


Top
 Profile  
 
 Post subject: Re: ZZT Ultra
PostPosted: Tue Aug 07, 2018 12:45 am 
Offline
I hope she made lotsa spaghetti!
User avatar

Joined: Sat May 20, 2006 2:58 am
Posts: 173
Location: LocacoLocacoL :LoL!
Sounds like good news indeed, Best of luck to you!


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 254 posts ]  Go to page Previous  1 ... 13, 14, 15, 16, 17

All times are UTC


Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Powered by phpBB® Forum Software © phpBB Group