# How to process the sound of a video?

**URL:** <https://discourse.processing.org/t/how-to-process-the-sound-of-a-video/11487>\
**Category:** Libraries\
**Created:** [May 22, 2019, 9:22am UTC](https://discourse.processing.org/t/how-to-process-the-sound-of-a-video/11487 "2019-05-22T09:22:59Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![kaotiklabs](https://avatars.discourse-cdn.com/v4/letter/k/2acd7d/32.png) [@kaotiklabs](https://discourse.processing.org/u/kaotiklabs)\
**Post date:** [May 22, 2019, 9:23am UTC](https://discourse.processing.org/t/how-to-process-the-sound-of-a-video/11487/1 "2019-05-22T09:23:00Z")

</div>

Hi,

I would like to access the movie sound data in order to detect high volume peaks to mark them as highlights.  
Any way to do it?

Preferebly without having to play the whole movie.

Thanks

---

<div class="post-metadata">

**Author:** ![jeremydouglass](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.processing.org/jeremydouglass/32/20_2.png) [@jeremydouglass](https://discourse.processing.org/u/jeremydouglass)\
**Post date:** [May 25, 2019, 1:21pm UTC](https://discourse.processing.org/t/how-to-process-the-sound-of-a-video/11487/2 "2019-05-25T13:21:18Z")

</div>

What kind of video file, with what kind of audio format embedded in it?

You may want to use ffmpeg as a pre-step. There is also a java library based on it called humble-video (untested).

> **[artclarke/humble-video](https://github.com/artclarke/humble-video)**
>
> Humble Video: Demuxing, Decoding, Filtering, Encoding and Muxing of 100's of video and audio formats and Codecs from the JVM - artclarke/humble-video

---

<div class="post-metadata">

**Author:** ![kaotiklabs](https://avatars.discourse-cdn.com/v4/letter/k/2acd7d/32.png) [@kaotiklabs](https://discourse.processing.org/u/kaotiklabs)\
**Post date:** [May 27, 2019, 10:13am UTC](https://discourse.processing.org/t/how-to-process-the-sound-of-a-video/11487/3 "2019-05-27T10:13:58Z")

</div>

Hi,  
my idea is coding an automated highlights video app based on face detection, sound detection and movement. Something similar to goPro Quik.  
Thats why I need access to the video sound stream.

I also need an easy way to chop and paste video timeframes, don’t know if there’s an easy way of doind it.

I will check your info. 🙂

---

<div class="post-metadata">

**Author:** ![neilcsmith](https://yyz2.discourse-cdn.com/flex036/user_avatar/discourse.processing.org/neilcsmith/32/144_2.png) [@neilcsmith](https://discourse.processing.org/u/neilcsmith)\
**Post date:** [May 27, 2019, 12:55pm UTC](https://discourse.processing.org/t/how-to-process-the-sound-of-a-video/11487/4 "2019-05-27T12:55:22Z")

</div>

GStreamer and the Java bindings, as used in the Processing Video library, would also support this. But the Video library doesn’t exactly make accessing it all that easy.