Date: Sat, 12 Dec 2015 21:15:10 +0100
From: Robert M Ochshorn
Subject: Pitch tracking hybrid timelines
I made a notes-on-a-video UI so I could give feedback for Joe's next talk. Here it is with a different talk loaded in:

image1.JPG

http://rmozone.com/snapshots/2015/12/marina-pitches/
(You can pretend to make/delete notes, but nothing will save)

- I used gentle to align the transcript with the audio

- to hint at intonation, I combined the textual representation with pitch tracking data
This (pitch tracking) turns out to be a subjective, and still somewhat open problem. I'm using code from Prof Ellis at Columbia U
Marit is in CC because she's interested in pitch tracking; she and other digital humanities people will visit CDG late December and mid January: more details when the dates are all confirmed

- i made new multi-scale thumbnail grids. The size of the image grows when it doesn't change very much. Still working out some kinks, but I find the approach very promising. In particular, you can ask questions like:
When, exactly, does the shot change?
What is in the shot?
How long is this shot? (Each line is 1sec)
Is there a transition? What sort?

- and then the rest is fairly standard nasty js tiny screen glue autoscrolling timeout seatbelt <video> etc

I may try to push this one a bit further. It seems like it offers a lot, even if it doesn't satisfy all of my Big Ideas about interlace anti-annotation video. 

Warmly from castle solitude,
RMO