The lower part of the algorithm converts the matrix into numerical values:.
Max msp visuals generator#
– operation jit.op * is responsible for multiplying the image matrix with the white line matrix, so that, for example, in the future - after connecting the audio generator - sound events appear only when the white line intersects the object/objects in the image (white pixels is a 1-value, black is a 0-value respectively, when black pixels intersect a white line (1 × 0=0) the result of their multiplication is zero and does not lead to a sound event, when white pixels of object/objects contour in the video image intersect a white line (1 × 1=1), on the contrary, sound events occur)
![max msp visuals max msp visuals](https://structure-void.com/wp-content/uploads/2020/09/01-1024x683.jpg)
![max msp visuals max msp visuals](https://i.ytimg.com/vi/Y0ZGJi0Q3Cc/maxresdefault.jpg)
– create a video output window ( jit.window ) and connect to it the image from the webcam and the line image – jit.op + operation is required to add image and white line matrices and display them on the screen (in order to see their intersection) – messages srcdimstart 0 $ 1 and srcdimend 126 $ 1, linked with the previously described object, transmit the white line coordinates to the matrix to cut off everything above and below it – object jit.matrix 1 char 127 1 1 0 0 128 0 1 highlights only a white line among all pixels of the 127 × 480 image, and accordingly, eliminates all pixels that are outside the line – the number in the numberbox (the screenshot shows the value of 196), which is attached to the object pak 0 0, determines the position of the white line in height – by adding objects pak 0 0, clear, setcell $ 1 $ 2 val 1., bang, jit.matrix 1 float 32 480, jit.matrix 1 float32 127 480 1 we create a white horizontal line with a 1 pixel height, 127 pixels long Next, go to the upper right part of the algorithm:.– the number in the numberbox (the screenshot shows the value 0.097), which is attached to jit.op 0.1, depends on the lighting only that image values which are greater than the number in the numberbox goes through the algorithm
![max msp visuals max msp visuals](https://static.wixstatic.com/media/bc7357_ffde8d2354064f96b452f006b11c861f~mv2.jpg)
– operations jit.op 0.1 and jit.slide 2 are responsible for the threshold that regulates the sensitivity of the motion detection system (the higher the threshold, the more pixels of the image will be eliminated) it is permissible to change the values in these operations – object t I I and operation jit.op absdiff connected by two cords subtract from each subsequent frame the previous one to make the algorithm to capture the movement giving the outline, the contour of the image – jit.matrix 1 float32 127 480 sets the matrix size: 127 on the X – axis and 480 on the Y – axis, where X-axis is responsible for the pitch scale (midi has 127 pitches) – jit.rgb2luma converts webcam images from color to black-and-white – jit.grab connects the webcam, open and close messages connected to jit.grab turn the webcam on and off respectively – qmetro33 is a metronome with a 33 milliseconds interval between clicks (captures about 30 frames per second), it starts the calculation process – toggle (“X”) is a controller to display the on/off status of the metronome
![max msp visuals max msp visuals](https://i.pinimg.com/600x315/b6/fb/d3/b6fbd3a2de9964d35f47ea09cfa1bdcd.jpg)
Practice of Strings : live set 2012 from Ujif_Notfound on Vimeo. Practically this method was used by Georgiy Potopalskiy in Car-Beat (2018), its visual representation can be seen in Practice of Strings (2011):
Max msp visuals how to#
The musician gradually explained how to make a patch in the Max/MSP program that will be able to convert the movements of the object/objects in the webcam video into sound events. On November 8, as part of the Pandemic Media Space project, media artist Georgiy Potopalskiy (alias Ujif_notfound) held a master class “Application of algorithms in media art”.