0329 - how to show the motion

This post is from my another class; media environment design studio 2013-1 : project 1 (link)

-
At first, I thought about how to make a relationship between motion and sound. That's the reason why I used a theremin. It could be measured the position with sound changes.




-
I hung 2 balls to the antenna with 2 types of thread ; elastic and inelastic.

and found values of x, y depth. (also sound pitch)

theremin + motion tracking

-
I got position values of 3 tracking points from the video I took, and then made a 3D object with 295 vertexes.

3d object _clip motion


screen capture _in Maya

_vertex.x = position.x (0-1024)
_vertex.y = position.y (0-768)
_vertex.z = peak value of theremin sound (1-1000)

-
And developed it using Plexus effect in After effects.

4 steps with Plexus

-
Next, I connected my previous work with the night view, because Prof. David said it reminded city lights at night. (and I think so, too)



In addition, I think a circular motion in the 1st video is very similar to a circumpolar star (or the diurnal motion), and city lights are stars on the ground.

-
Based on this idea, I combined 2 different motions and made a kinetic object using Syntheyes.


5 videos ; theremin + city lights

_ video 1
_ video 2
_ video 1+2 _dot pixels
_ video 1+2 _plexus_line
_ video 1+2 _plexus_triangulation

I think Syntheyes is much easier to track than Tracker in After effects.

screen capture in Syntheyes 


screen capture in Syntheyes

screen capture in After effects

-
When I tracked the video using Syntheyes, there were some errors from the movements of tracking points. Maybe it was because of cars.

error in Syntheyes and my previous work

I thought this error (or some motions and sounds) could be used for making various changes, and develop my works.

-
So I took more videos and made some kinetic sculptures controlled by motion. The right side of the video is added a previous motion, and all motions are connected.

kinetic city sculpture
_ video 1 / video 1
_ video 2 / video 1+2
_ video 3 / video 1+2+3

screen capture in After effects


0316 - experiment ; game rules + QR code

I thought the rules of Baduk (or chessChinese checkers, etc) can give variety to fixed motions, and change the sound. But this was NOT a useful experiment for my thesis.

Can I use this idea for another work?

-
This experiment shows how game rules can change the sound.
I chose 2 songs randomly, and arranged go stones. Also some stones were removed according to the rules.

1st _ The Four Seasons ; Autumn 
2nd _ Moon River (white) vs The Four Seasons ; Autumn (black) 

-
Also this process reminded me of QR code. So I made some pixel images using these records of Baduk.

QR codes for my blogs 




Baduk codes for sounds 


-
I think I need to research about gesture and sound.


0312 - analysis

Still I don't know how I can develop this subject, so I organized my thoughts about sound and gesture.

-
1/ the relation between sound pitch, human body, and math ; about length

sound pitch _organ / violin 

This is also related to Pythagorean tuning.



unit of length with human body + Maya numerals 


2/ visual or structural similarity with musical instrument + sheet

organ / organ sheet _ Twinkle Twinkle Little Star 
bread board / go equipment 
nonogram 

http://en.wikipedia.org/wiki/File:Paint_by_numbers_-_Solving_-_Example9.png


3/ the relation between kinect and theremin


2013
main / network / new post / posts / pages / template / customize / layout
hleefactory@gmail.com
THESIS BLOG >


Human and Computer ;
The Visible and The Invisible

-
Hayoun Lee

-
Supervisor
Prof. David Hall





논문 블로그 >


인간과 컴퓨터 ;
보이는 것과 보이지 않는 것

-
이하연

-
지도교수
데이빗 홀 교수님


100
536
180