Rendering Kinect Point Cloud with Vertex Buffer Object (VBO)

Question

I´m trying to make a dynamic point cloud visualizer. The points are updated every frame with Kinect Sensor. To grab the frames I´m using OpenCV and GLUT to display. The OpenCV API returns a 640 x 480 (float *), for the points xyz position , and a 640 x 480 (int *) for the rgb color data. To get the maximum performance, I´m trying to use Vertex Buffer Object in stream mode instead of a simple Vertex Array. I´m being able to render it with Vertex Array, but nothing is being rendered with my VBO implementation. I tryied a bunch of different orders in the declarations, but i can't find what I'm missing. Can someone try to point me to the right direction? Here is the simpflified code: (I´ve rewrited the wrong version as asked by Christian Rau, so you guys can understand my mistakes)

int main()
{
    //Delaring variables, inittiating glut, setting camera and checking the compatibility as http://www.songho.ca/opengl/gl_vbo.html
    glutDisplayFunc(displayCB);
    glutIdleFunc(displayCB); 
    ... 
    //Inittiating the vertex buffers
    if(vboSupported)
    {
        glGenBuffers(1, &vertex_buffer);
        glBindBuffer(GL_ARRAY_BUFFER_ARB, buffer);
        glBufferData(GL_ARRAY_BUFFER_ARB, (sizeof(GLfloat) * 640 * 480 * 3), 0, GL_STREAM_DRAW_ARB);
        glBufferSubData(GL_ARRAY_BUFFER_ARB, 0,  (sizeof(float) * 640 * 480 * 3), point_cloud.points_position); 

        glGenBuffers(2, &color_buffer);
        glBindBuffer(GL_ARRAY_BUFFER_ARB, buffer);
        glBufferData(GL_ARRAY_BUFFER_ARB, (sizeof(GLbyte) * 640 * 480 * 3), 0, GL_STREAM_DRAW_ARB);
        glBufferSubData(GL_ARRAY_BUFFER_ARB, 0,  (sizeof(char) * 640 * 480 * 3), point_cloud.points_color); 
    }
    //glutMainLoop(), cleaning memory, ending main
    ..
}

//Updating the screen
void displayCB()
{
    point_cloud.update();

    // clear buffer
    glClear(GL_COLOR_BUFFER_BIT | GL_DEPTH_BUFFER_BIT | GL_STENCIL_BUFFER_BIT);

    // save the initial ModelView matrix before modifying ModelView matrix
    glPushMatrix();

        glBindBuffer(GL_ARRAY_BUFFER_ARB, color_buffer);
        glBufferSubData(GL_ARRAY_BUFFER_ARB, 0,  (sizeof(char) * 640 * 480 * 3), point_cloud.points_color); 
        glColorPointer(3, GL_UNSIGNED_BYTE, 0, 0);

        glBindBuffer(GL_ARRAY_BUFFER_ARB, vertex_buffer);
        glBufferSubData(GL_ARRAY_BUFFER_ARB, 0,  (sizeof(float) * 640 * 480 * 3), point_cloud.points_position); 
        glVertexPointer(3, GL_FLOAT, 0, 0));

        // enable vertex arrays
        glEnableClientState(GL_VERTEX_ARRAY);
        glEnableClientState(GL_COLOR_ARRAY);

        glDrawArrays(GL_POINT, 0, 640*480);

        glDisableClientState(GL_VERTEX_ARRAY);  // disable vertex arrays
        glDisableClientState(GL_COLOR_ARRAY);

        glBindBuffer(GL_ARRAY_BUFFER_ARB, 0);

    glPopMatrix();

    glutSwapBuffers();
}

Amin

Quite unrelated comment: rather use glBufferData (instead of glBufferSubData) when updating the whole buffer. This might help the driver to optimize things, but I won't go into detail on that now. At least in the main code the glBufferSubData following a glBufferData is completely useless. – Roshelle

You should rather append new versions of your code to the question, instead of completely changing the question's code after each answer or comment, as this invalidates other answers and people reading the question and answers get completely confused. – Roshelle

I do this by postint as a new answer? – Amin

No, you just edit your question like so: "UPDATE: According to ...'s answer/comment I changed the code/...part to ... but it still doesn't work/now I have these errors ..." or something similar. But you shouldn't just overwrite your exisiting question code (at least not if the changes are rather significant), especially when this invalidates other answers. – Roshelle

Since you've solved the problem, you might consider adding the solution as an answer, then tagging it as such so as to remove this question from the Unanswered list. – Kempis

Done. Sorry, but i didn't knew it. :) – Amin

Answer 1

PS: The program is up and running, but I can't see any improvement in the average performance when compared to the Vertex Array version. Is that alright? THE PROBLEM WAS SOLVED. I´ve done three alterations:

1 - I though that glGenBuffers first parameter was the number that
would be associated to the buffer, instead, its the number of
buffers that would be allocated. This doesn't matter anyway, because
now I'm using a single buffer and adding all the data to it. Didn't
solved the problem, but was going in the right way.

2 - There are two ways of being able to use OpenGL VBO functions.
First, you can bind the ARB  version functions by yourself OR you
can add glew.h and use glewInit() after starting an OpenGL context.
The second option is a LOT cleaner and I changed my code so I don't
use the ARB versions anymore. Still didn't solved the problem.

3 - Christian Rau asked me for glErrors in the code, so, I wrote it
after each OpenGL operation in displayCB. After glDrawArrays I got
an 0x00500 error, that means there is an invalid enum, so I noticed
I was using GL_POINT as parameter to glDrawArrays, instead of
GL_POINTS, so silly that makes me want to kill myself.

The final code:

//EDIT: Added glew.h as a header and I´m not using the ARB version anymore
#include <glew.h>

    int main()
    {
        //Declaring variables, initiating glut, setting camera and checking the compatibility as http://www.songho.ca/opengl/gl_vbo.html
        glutDisplayFunc(displayCB);
        glutIdleFunc(displayCB); 
        ...

        //EDIT: IS VERY IMPORTANT TO ADD IT AS SOON AS YOU START AN OPENGL CONTEXT.
        initGlew();

        //Inittiating the vertex buffers
        if(vboSupported)
        {
           //EDIT: I was using two buffers, one for color and another for the vertex. I changed the code so I use  a single buffer now.
           //EDIT: Notice that I'm not using the ARB version of the functions anymore.
            glGenBuffers(1, &buffer);
            glBindBuffer(GL_ARRAY_BUFFER_ARB, buffer);
            glBufferData(GL_ARRAY_BUFFER_ARB, (sizeof(GLfloat) * 640 * 480 * 3) + (sizeof(GLbyte) * 640 * 480 * 3), 0, GL_STREAM_DRAW_ARB);
        }
        //glutMainLoop(), cleaning memory, ending main
        ..
    }

    //Updating the screen
    void displayCB()
    {
        point_cloud.update();

        // clear buffer
        glClear(GL_COLOR_BUFFER_BIT | GL_DEPTH_BUFFER_BIT | GL_STENCIL_BUFFER_BIT);

        // save the initial ModelView matrix before modifying ModelView matrix
        glPushMatrix();

            glBindBuffer(GL_ARRAY_BUFFER_ARB, buffer);
            glBufferSubData(GL_ARRAY_BUFFER_ARB, 0,  (sizeof(char) * 640 * 480 * 3), point_cloud.points_color); 
            glBufferSubData(GL_ARRAY_BUFFER_ARB, (sizeof(char) * 640 * 480 * 3), (sizeof(float) * 640 * 480 * 3), point_cloud.points_position);

            // enable vertex arrays
            glEnableClientState(GL_VERTEX_ARRAY);
            glEnableClientState(GL_COLOR_ARRAY);

            glColorPointer(3, GL_UNSIGNED_BYTE, 0, 0);
            //EDIT: Added the right offset at the vertex pointer position
            glVertexPointer(3, GL_FLOAT, 0, (void*)(sizeof(char) * 640 * 480 * 3));

            //EDIT: Was using GL_POINT instead of GL_POINTS
            glDrawArrays(GL_POINTS, 0, 640*480);

            glDisableClientState(GL_VERTEX_ARRAY);  // disable vertex arrays
            glDisableClientState(GL_COLOR_ARRAY);

            glBindBuffer(GL_ARRAY_BUFFER_ARB, 0);

        glPopMatrix();

        glutSwapBuffers();
    }

Amin