Date: Tue, 7 Nov 2023 11:05:09 -0500
From: Luke Iannini
Subject: Re: Audio & MIDI / Realtime Realtalk


On Nov 2, 2023, at 5:55 PM, Bret Victor <****************> wrote:

All so great!

Parallel and color-coded knobs are very cool!  I couldn't help think about the old "scrub this number tool", which would attach to the closest number in the text and let you adjust it.  It didn't work well, but it suggests a way of adjusting parameters without declaring them as parameters.  One idea is that if your knob box has 16 knobs, the first 16 numbers in the text of the closest page get labelled or color-coded, and you can instantly adjust any of them by turning the corresponding knob.  If there are particular numbers in the text that you really want to adjust, maybe you just write them as "adjustable(1.75)", and they are always assigned to the first knobs.
Yeah, I was also thinking a fun intermediate could be to convert anything declared as "local fizziness = 4" to a parameter (perhaps with ranges or other meta-info in a comment) automatically, like we do for our automatic logging! But there's also something special about reaching in to grab any numeric literal.


The animated keyboard is beautiful!  It's such a shift any time we make formerly-self-contained devices aware of their physical layout and affect the space around themselves (e.g. the tablet, the pi bots, the qwerty keyboards...).  In the case of audio, I wonder if it would be interesting to put dot frames around portable speakers, and have objects play their audio out of the closest speaker.  (Or out of all speakers, but attenuated by distance?)  You could position speakers around the table and get an nice "sound space".
Yes! I had something like that working with our 8-speaker theater setup at DL1 where you could wish an object plays sound within the area and it would quadraphonically (/octaphonically) pan the sound in the space, even more fun to have the speakers as dot-framed objects!


Seems like you're 95% of the way to replicating the La Tabla music mode with hand-drawn scores, especially with the Tidal recognizers.
Totally : ) and the timing in this Realtalk edition is way better than anything La Tabla had!


The implementation poster with live feedback really feels like a hint of the future.  (And even a bit of the past, reminiscent of our first Realtalk-on-the-wall.)  Once that gets combined with the new Realtext on cards, and with embedded diagrams and spatial layouts, I think it'll really feel like a new era.

And especially the idea that a poster can be its own area.  It's always been a bit of a stretch to refer to a thread as an "area", because they're not as spatially present as we wish they were.  But maybe in order to have an area, you have to assign at least one physical space to it (a table, a wall, a posterboard, a page, a box).  You could configure permanent areas with Setup Kit, create ad hoc areas by simply claiming that some posterboard is in an area, and dynamically spin up "virtual" areas by making boxes.  So when you think of "the audio area", you would be literally thinking of the area bounded by the physical posterboard.  
Yeah, I think that would be fantastic — spawning areas within the rulebook is currently a bit spooky, with pages that run both in the main area and the spawned area with different behavior, which gets a bit mind-bending and error prone — having a clear spatial representation of what's in and what's out (including visualizing inter-area communication, and agents sent from other areas!) would be a big step forward!!


Dog wipe!
IMG_0160.jpeg



On Nov 2, 2023, at 11:59 AM, Luke Iannini <****************> wrote:

15min
[video.mkv]


(apologies for the unfortunate camera placement in section 3 and the resulting massive floating head haha)

--
************************


--
************************