Just tried adding some audio-visual effect onto an portrait painting generated by AI. The full video:https://youtu.be/w4WUDmZYKOQ The original painting generated by AI, a model using StyleGAN2. The visual effect created mostly from shader.And I used the handy and cool software “Fragment:Flow” based on MaxMSP/Jitter. BGM: “Green Lake Remix 006”, by dogone – my old friend who can repair airplanes.
Just other computational audio reactive visuals, generated by StyleGAN2.Still have a lot to do. AILog.001-005 are images:https://www.instagram.com/avantcontra/ Donate: https://www.patreon.com/avantcontra There are many articles, patches, source code and some advanced Patron-only content there. Or you can get a source code/patch directly in gumroad.https://gumroad.com/avantcontra If you like something, could buy me a coffee 😀 More articles: https://medium.com/@contra [Experimental Programming], meaning is derived from experimental art, experimental electronics, or experimental music. And that’s
The key steps of the video above: Use the PoseNet of TensorFlow based on web-based machine learning for motion capture; Link the PoseNet page to MaxMSP with the Node for Max module provided by MaxMSP; Human motion data captured by PoseNet is sent back to MaxMSP through SocketIO; MaxMSP sends the received data to Blender via OSC; Blender uses the received data to control the deformation animation in real time.
These days I’m learning machine learning and trying generating visual things based on StyleGAN, a neural network. AILog005, was first sent to my wife, she said: “OK, more suppressed.” Great! This is the feeling I’m looking for. Not only do I specifically mean “suppression”, but I finally have a way of expressing myself, and it is “obscure”. As a programmer , when I want to express emotions, Draw a picture,
#004 is a homework of Machine Learning about Matrix operating and txt file r/w using MaxMSP. I just start to study Machine Learning from Hung-yi Lee’s open video. https://youtu.be/CXgbekl66jc This demo implemented some Matrix operating from the first homework HW0-Q1: step 1: read two matrix data from two text file; step 2: matrixA * matrxB; step 3: sort the final list and save to a txt file one number per