# Video Processing with a Rasperry Pi

**URL:** <https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540>\
**Category:** Processing for Pi\
**Created:** [November 14, 2018, 7:08pm UTC](https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540 "2018-11-14T19:08:50Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![dimpap5555](https://avatars.discourse-cdn.com/v4/letter/d/cdc98d/32.png) [@dimpap5555](https://discourse.processing.org/u/dimpap5555)\
**Post date:** [November 14, 2018, 7:08pm UTC](https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540/1 "2018-11-14T19:08:50Z")

</div>

Hello there. I have been working on a CV project with a raspberry pi for a Robotics Competition. I am not really experienced within the field of CV though (Working more on the electronics in general). So I am seeking your help. I did some research and found out some pieces of code and merged them together (not always the best idea apparently). Basically, I got the code from that video: [https://www.youtube.com/watch?v=nCVZHROb\_dE&index=2&list=PLRqwX-V7Uu6aG2RJHErXKSWFDXU4qo\_ro](https://www.youtube.com/watch?v=nCVZHROb_dE&index=2&list=PLRqwX-V7Uu6aG2RJHErXKSWFDXU4qo_ro) and used gohai’s Video library to adapt the whole thing with my Raspberry. My code is that one over here:

```auto
import gohai.glvideo.*;
GLCapture video;
color trackColor; 
float threshold = 25;

void setup() {
  size(320, 200, P2D);

  String[] devices = GLCapture.list();
  println("Devices:");
  printArray(devices);
  if (0 < devices.length) {
    String[] configs = GLCapture.configs(devices[0]);
    println("Configs:");
    printArray(configs);
  }
  video = new GLCapture(this);

  video.start();
  trackColor = color(255, 0, 0);
}

void draw() {
  background(0);
  if (video.available()) {
    video.read();
  }
  image(video, 0, 0, width, height);
  threshold = 80;

  float avgX = 0;
  float avgY = 0;

  int count = 0;

  for (int x = 0; x < video.width; x++ ) {
    for (int y = 0; y < video.height; y++ ) {
      int loc = x + y * video.width;
      color currentColor = video.pixels[loc];
      float r1 = red(currentColor);
      float g1 = green(currentColor);
      float b1 = blue(currentColor);
      float r2 = red(trackColor);
      float g2 = green(trackColor);
      float b2 = blue(trackColor);

      float d = distSq(r1, g1, b1, r2, g2, b2); 

      if (d < threshold*threshold) {
        stroke(255);
        strokeWeight(1);
        point(x, y);
        avgX += x;
        avgY += y;
        count++;
      }
    }
  }

  if (count > 0) { 
    avgX = avgX / count;
    avgY = avgY / count;
    // Draw a circle at the tracked pixel
    fill(255);
    strokeWeight(4.0);
    stroke(0);
    ellipse(avgX, avgY, 24, 24);
  }
}

float distSq(float x1, float y1, float z1, float x2, float y2, float z2) {
  float d = (x2-x1)*(x2-x1) + (y2-y1)*(y2-y1) +(z2-z1)*(z2-z1);
  return d;
}

void mousePressed() {
  int loc = mouseX + mouseY*video.width;
  trackColor = video.pixels[loc];
}

```

I keep getting a “ArrayOutOfBoundsException” here “color currentColor = video.pixels[loc];”.  
I am really seeking an experienced man’s help here (what do you expect from a newbie like me anyways).  
Thank you for your time!

---

<div class="post-metadata">

**Author:** ![jb4x](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.processing.org/jb4x/32/789_2.png) [@jb4x](https://discourse.processing.org/u/jb4x)\
**Post date:** [November 15, 2018, 7:37pm UTC](https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540/2 "2018-11-15T19:37:50Z")

</div>

Hi dimpap5555,

Please edit your previous post and format your code. The icon look like this: `</>`

The error that you get basically told you that you try to access an element that is not in the array: `video.pixels` in your case. It means that at some points, the `loc` variable is too big and point outside of your array.

Now, looking at how you compute loc, everything should be alright. My guess is that when you launch the program, the first time you enter to `draw()` function, you get no available frame from your camera so you don’t read any picture so your video variable stays empty: explaining the error you get.

Try putting everything in between your if statement and see if it works. If that’s the case, then my guess is correct. Otherwise, we will need to dig deeper =)

---

<div class="post-metadata">

**Author:** ![dimpap5555](https://avatars.discourse-cdn.com/v4/letter/d/cdc98d/32.png) [@dimpap5555](https://discourse.processing.org/u/dimpap5555)\
**Post date:** [November 17, 2018, 6:34pm UTC](https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540/3 "2018-11-17T18:34:57Z")

</div>

Ugh, it did not work unfortunately. I put all the draw() code on the “if availiable” condition. Nothing though. Same error.

---

<div class="post-metadata">

**Author:** ![jb4x](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.processing.org/jb4x/32/789_2.png) [@jb4x](https://discourse.processing.org/u/jb4x)\
**Post date:** [November 17, 2018, 9:06pm UTC](https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540/4 "2018-11-17T21:06:26Z")

</div>

Omg… I know why…

You did not load the pixels so the pixel array is never updated: [https://processing.org/reference/loadPixels\_.html](https://processing.org/reference/loadPixels_.html)

If you don’t want to do that you can still use the `get()` function but it will be slower:

> <https://github.com/gohai/processing-glvideo/blob/master/src/gohai/glvideo/GLVideo.java#L392-L397>

---

<div class="post-metadata">

**Author:** ![dimpap5555](https://avatars.discourse-cdn.com/v4/letter/d/cdc98d/32.png) [@dimpap5555](https://discourse.processing.org/u/dimpap5555)\
**Post date:** [November 17, 2018, 10:24pm UTC](https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540/5 "2018-11-17T22:24:37Z")

</div>

Alright seems legit. What should I do exactly though? Sorry for that, as said I am not that experienced. I know coding but it’s my first time working with CV and processing.

---

<div class="post-metadata">

**Author:** ![dimpap5555](https://avatars.discourse-cdn.com/v4/letter/d/cdc98d/32.png) [@dimpap5555](https://discourse.processing.org/u/dimpap5555)\
**Post date:** [November 17, 2018, 10:55pm UTC](https://discourse.processing.org/t/video-processing-with-a-rasperry-pi/5540/6 "2018-11-17T22:55:59Z")

</div>

Nevermind. I tinkered a bit by myself and made it work! I really appreciate your help! Thank you very much!