Play an audio sample grabbed using JavaCV

UPDATED 11/05/2015
Hy friends,its been 1 and half years,posting here.Sorry for this much long delay because of my studies and increasing my memory.My memory is now advanced friends.Here it is after a long time iam gonna give the most frustrating problem developers facing off.

Here it is,iam running a marathon for weeks to find a solution for this problem.First of all i asked to the Javacv groups, to find a solution.


Here i have found my way to the destination with just a keyword provided by Samuel Audet(JavaCV Project Member).


What is the way to play the raw float from javacv to android?Here it is i have created a class.Take it on for free.

package com.shihabsoft.castanythingtopc;
public class AndroidAudioDevice
AudioTrack track;
short[] buffer = new short[1024];
public AndroidAudioDevice(int sampleRate,int channels)
      int minSize =AudioTrack.getMinBufferSize(sampleRate, channels==1?AudioFormat.CHANNEL_CONFIGURATION_MONO:AudioFormat.CHANNEL_CONFIGURATION_STEREO, AudioFormat.ENCODING_PCM_16BIT );      
      track = new AudioTrack( AudioManager.STREAM_MUSIC, sampleRate, channels==1?AudioFormat.CHANNEL_CONFIGURATION_MONO:AudioFormat.CHANNEL_CONFIGURATION_STEREO, AudioFormat.ENCODING_PCM_16BIT,minSize, AudioTrack.MODE_STREAM);;          
public void writeSamples(float[] samples)
    fillBuffer( samples );
    track.write( buffer, 0, samples.length );  
private void fillBuffer( float[] samples )  
   if( buffer.length < samples.length )  
     buffer = new short[samples.length];
   for( int i = 0; i < samples.length; i++ )  
     buffer[i] = (short)(samples[i] * Short.MAX_VALUE);

How to use my class.

AndroidAudioDevice aaD=new AndroidAudioDevice(sampleRate Hz,numberOfChannels);

But iam not so cruel :) ,to leave you after crossing half-quarter of the sea.Here it is i have created the code from top to end ie,Frame to float array.Feel free to use it.

final java.nio.Buffer[] samples=vFrame.samples;
//Getting the samples from the Frame from grabFrame()
float[] smpls;
//For using with mono track
    Buffer b=samples[0];
    fb = (FloatBuffer)b;
    smpls=new float[fb.capacity()];
else if(aaD.track.getChannelCount()==2)
//For using with stereo track
    FloatBuffer b1=(FloatBuffer) samples[0];
    FloatBuffer b2=(FloatBuffer) samples[1];
    smpls=new float[b1.capacity()+b2.capacity()];
    for(int i=0;i<b1.capacity();i++)
         smpls[2*i]=b1.get(i);  smpls[2*i+1]=b2.get(i);

Don't ever put the sampleRate and audioChannels manually,Just grab that both from FFmpegFrameRecorder.

Because incase the video have a sample rate of 44kHz and you are initializing the audio track with 8000Hz,the audio will be so distored you may never hear a voice.So be carefull on those two params.

Let me know if you guys are inneed of more details.
For soon i will post a new Sample Application in the JavaCV project.

Asked by Sam.
Share on Google Plus

About Shihab Soft

I am Shihab, people used to call me a Security researcher or sometimes a Reverse engineer or sometimes a creepy hacker ;). Got a brain full of knowledge in different programming languages, and not more nor less I am a blogger too :).
    Blogger Comment
    Facebook Comment


Post a Comment

Don't be shy. Just leave your comments, am so happy to assist you. And, don't forgot that I am such a nice person who you are dealing with :)

Don't be shy. Just, leave your comments. Iam so happy to assist you. And, don't forgot that, I am such a nice person who you are dealing with :)