Serial Ports List:
/dev/cu.Bluetooth-Incoming-Port /dev/cu.MINIJAMBOXbyJawbone-SPP /dev/cu.usbmodem3292521 /dev/tty.Bluetooth-Incoming-Port /dev/tty.MINIJAMBOXbyJawbone-SPP /dev/tty.usbmodem3292521
Restarting...
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
JNA: could not detach thread
thats how it looks, looks to me like buffer overflow, but I'm new to processing I just know Supercollider and that's a bit differrent
the error start after approx. 4 seconds. The restart print is at the very beginning, I initialized the prevTime variable with 0.02
Does it only print the JNA error? It does that for me too sometimes but the sketch keeps on running. Do you still get output to the LED wall? @neilcsmith can probably give more explanations about this error…
Also, are you running on Linux?
I had to put my kids to bed… I do’t mind the errors, but it crashes after one or two minutes, while doing everything right…
buffer overflow ?
as soon as I do this: movieTime = m.time(); I get the errors
I run os x
ok I’ll try it now the other way round. A OSC trigger starts the Processing sketch
It works…! … almost
the Bang starts to play the movie. But after the movie went thru I cannot restart the sketch with another bang have a look
/* OctoWS2811 movie2serial.pde - Transmit video data to 1 or more
Teensy 3.0 boards running OctoWS2811 VideoDisplay.ino
http://www.pjrc.com/teensy/td_libs_OctoWS2811.html
Copyright (c) 2013 Paul Stoffregen, PJRC.COM, LLC
Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
THE SOFTWARE.
*/
// To configure this program, edit the following sections:
//
// 1: change myMovie to open a video file of your choice ;-)
//
// 2: edit the serialConfigure() lines in setup() for your
// serial device names (Mac, Linux) or COM ports (Windows)
//
// 3: if your LED strips have unusual color configuration,
// edit colorWiring(). Nearly all strips have GRB wiring,
// so normally you can leave this as-is.
//
// 4: if playing 50 or 60 Hz progressive video (or faster),
// edit framerate in movieEvent().
import processing.video.*;
import processing.serial.*;
import java.awt.Rectangle;
import oscP5.*;
import netP5.*;
OscP5 oscP5;
NetAddress myRemoteLocation;
//Movie myMovie = new Movie(this, "/Users/nicholas/Documents/LEDrevolution/1776.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Music/revolutionary_songs_in_a_AI_Environment/LEDrevolution/1789.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Music/revolutionary_songs_in_a_AI_Environment/LEDrevolution/1848.mov");
Movie myMovie = new Movie(this, "//Users/nicholas/Music/revolutionary_songs_in_a_AI_Environment/LEDrevolution/1871.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Music/revolutionary_songs_in_a_AI_Environment/LEDrevolution/1917.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Documents/LEDrevolution/1949.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Documents/LEDrevolution/1966.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Documents/LEDrevolution/1970.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Music/revolutionary_songs_in_a_AI_Environment/LEDrevolution/1978.mov");
//Movie myMovie = new Movie(this, "/Users/nicholas/Music/revolutionary_songs_in_a_AI_Environment/LEDrevolution/1980.mov");
float gamma = 2.8;
int numPorts=0; // the number of serial ports in use
int maxPorts=24; // maximum number of serial ports
Serial[] ledSerial = new Serial[maxPorts]; // each port's actual Serial port
Rectangle[] ledArea = new Rectangle[maxPorts]; // the area of the movie each port gets, in % (0-100)
boolean[] ledLayout = new boolean[maxPorts]; // layout of rows, true = even is left->right
PImage[] ledImage = new PImage[maxPorts]; // image sent to each port
int[] gammatable = new int[256];
int errorCount=0;
float framerate=0;
float duration=0;
float movieTime=0;
float prevTime=0.033;
void setup() {
oscP5 = new OscP5(this,12000); // listening to OSC 12000
String[] list = Serial.list();
delay(20);
println("Serial Ports List:");
println(list);
serialConfigure("/dev/tty.usbmodem3292521"); // change these to your port names
//serialConfigure("/dev/ttyACM1");
if (errorCount > 0) exit();
for (int i=0; i < 256; i++) {
gammatable[i] = (int)(pow((float)i / 255.0, gamma) * 255.0 + 0.5);
}
size(480, 380); // create the window
}
/* incoming osc message are forwarded to the oscEvent method. */
void oscEvent(OscMessage theOscMessage) {
/* print the address pattern and the typetag of the received OscMessage */
myMovie.play(); // start the movie :-)
}
// movieEvent runs for each new frame of movie data
void movieEvent(Movie m) {
// read the movie's next frame
m.read();
//if (framerate == 0) framerate = m.getSourceFrameRate();
framerate = 30.0; // TODO, how to read the frame rate???
for (int i=0; i < numPorts; i++) {
// copy a portion of the movie's image to the LED image
int xoffset = percentage(m.width, ledArea[i].x);
int yoffset = percentage(m.height, ledArea[i].y);
int xwidth = percentage(m.width, ledArea[i].width);
int yheight = percentage(m.height, ledArea[i].height);
ledImage[i].copy(m, xoffset, yoffset, xwidth, yheight,
0, 0, ledImage[i].width, ledImage[i].height);
// convert the LED image to raw data
byte[] ledData = new byte[(ledImage[i].width * ledImage[i].height * 3) + 3];
image2data(ledImage[i], ledData, ledLayout[i]);
if (i == 0) {
ledData[0] = '*'; // first Teensy is the frame sync master
int usec = (int)((1000000.0 / framerate) * 0.75);
ledData[1] = (byte)(usec); // request the frame sync pulse
ledData[2] = (byte)(usec >> 8); // at 75% of the frame time
} else {
ledData[0] = '%'; // others sync to the master board
ledData[1] = 0;
ledData[2] = 0;
}
// send the raw data to the LEDs :-)
ledSerial[i].write(ledData);
}
}
// image2data converts an image to OctoWS2811's raw data format.
// The number of vertical pixels in the image must be a multiple
// of 8. The data array must be the proper size for the image.
void image2data(PImage image, byte[] data, boolean layout) {
int offset = 3;
int x, y, xbegin, xend, xinc, mask;
int linesPerPin = image.height / 8;
int pixel[] = new int[8];
for (y = 0; y < linesPerPin; y++) {
if ((y & 1) == (layout ? 1 : 0)) { //changed from originally: (layout ? 0 : 1)
// even numbered rows are left to right
xbegin = 0;
xend = image.width;
xinc = 1;
} else {
// odd numbered rows are right to left
xbegin = image.width - 1;
xend = -1;
xinc = -1;
}
for (x = xbegin; x != xend; x += xinc) {
for (int i=0; i < 8; i++) {
// fetch 8 pixels from the image, 1 for each pin
pixel[i] = image.pixels[x + (y + linesPerPin * i) * image.width];
pixel[i] = colorWiring(pixel[i]);
}
// convert 8 pixels to 24 bytes
for (mask = 0x800000; mask != 0; mask >>= 1) {
byte b = 0;
for (int i=0; i < 8; i++) {
if ((pixel[i] & mask) != 0) b |= (1 << i);
}
data[offset++] = b;
}
}
}
}
// translate the 24 bit color from RGB to the actual
// order used by the LED wiring. GRB is the most common.
int colorWiring(int c) {
int red = (c & 0xFF0000) >> 16;
int green = (c & 0x00FF00) >> 8;
int blue = (c & 0x0000FF);
red = gammatable[red];
green = gammatable[green];
blue = gammatable[blue];
return (green << 16) | (red << 8) | (blue); // GRB - most common wiring
}
// ask a Teensy board for its LED configuration, and set up the info for it.
void serialConfigure(String portName) {
if (numPorts >= maxPorts) {
println("too many serial ports, please increase maxPorts");
errorCount++;
return;
}
try {
ledSerial[numPorts] = new Serial(this, portName);
if (ledSerial[numPorts] == null) throw new NullPointerException();
ledSerial[numPorts].write('?');
} catch (Throwable e) {
println("Serial port " + portName + " does not exist or is non-functional");
errorCount++;
return;
}
delay(50);
String line = ledSerial[numPorts].readStringUntil(10);
if (line == null) {
println("Serial port " + portName + " is not responding.");
println("Is it really a Teensy 3.0 running VideoDisplay?");
errorCount++;
return;
}
String param[] = line.split(",");
if (param.length != 12) {
println("Error: port " + portName + " did not respond to LED config query");
errorCount++;
return;
}
// only store the info and increase numPorts if Teensy responds properly
ledImage[numPorts] = new PImage(Integer.parseInt(param[0]), Integer.parseInt(param[1]), RGB);
ledArea[numPorts] = new Rectangle(Integer.parseInt(param[5]), Integer.parseInt(param[6]),
Integer.parseInt(param[7]), Integer.parseInt(param[8]));
ledLayout[numPorts] = (Integer.parseInt(param[5]) == 0);
numPorts++;
}
// draw runs every time the screen is redrawn - show the movie...
void draw() {
// show the original video
image(myMovie, 0, 80);
// then try to show what was most recently sent to the LEDs
// by displaying all the images for each port.
for (int i=0; i < numPorts; i++) {
// compute the intended size of the entire LED array
int xsize = percentageInverse(ledImage[i].width, ledArea[i].width);
int ysize = percentageInverse(ledImage[i].height, ledArea[i].height);
// computer this image's position within it
int xloc = percentage(xsize, ledArea[i].x);
int yloc = percentage(ysize, ledArea[i].y);
// show what should appear on the LEDs
image(ledImage[i], 240 - xsize / 2 + xloc, 10 + yloc);
}
}
// respond to mouse clicks as pause/play
boolean isPlaying = true;
void mousePressed() {
if (isPlaying) {
myMovie.pause();
isPlaying = false;
} else {
myMovie.play();
isPlaying = true;
}
}
// scale a number by a percentage, from 0 to 100
int percentage(int num, int percent) {
double mult = percentageFloat(percent);
double output = num * mult;
return (int)output;
}
// scale a number by the inverse of a percentage, from 0 to 100
int percentageInverse(int num, int percent) {
double div = percentageFloat(percent);
double output = num / div;
return (int)output;
}
// convert an integer from 0 to 100 to a float percentage
// from 0.0 to 1.0. Special cases for 1/3, 1/6, 1/7, etc
// are handled automatically to fix integer rounding.
double percentageFloat(int percent) {
if (percent == 33) return 1.0 / 3.0;
if (percent == 17) return 1.0 / 6.0;
if (percent == 14) return 1.0 / 7.0;
if (percent == 13) return 1.0 / 8.0;
if (percent == 11) return 1.0 / 9.0;
if (percent == 9) return 1.0 / 11.0;
if (percent == 8) return 1.0 / 12.0;
return (double)percent / 100.0;
}
Try adding myMovie.stop(); before the line myMovie.play(); in the method that retrieves the OSC message, or myMovie.jump(0);.
1 Like
btw I’m very impressed with engagement and the helpful atmosphere at this forum, this is joy!
1 Like
Bingo this works, let’s see how I will stay in sync !
thank you everybody I will keep you posted
It’s not an error message as such, just a warning. By default when GStreamer calls back to Java with a new frame, JNA attaches and detaches the streaming thread from the JVM (so it can call your movieEvent() ). For some reason the detachment process is showing warnings suggesting the detachment fails / had already happened. It shouldn’t cause a problem. Does it still do that without the calls to time() etc. out of interest?
The Processing Video v2 beta uses the GStreamer 1.x bindings, which doesn’t detach every frame (based on code I got into JNA), so will be more efficient and should not show the same error message / problem.
Incidentally, the fact that movieEvent() is called on GStreamer’s streaming thread rather than the Processing animation loop is why I suggested moving the serial port sending into draw()