Skip to main content

mediapipe_audio 0.3.0 copy "mediapipe_audio: ^0.3.0" to clipboard
mediapipe_audio: ^0.3.0 copied to clipboard

Google's MediaPipe Audio Classifier (every platform and the web), Audio Transcriber and Text to Speech for Flutter, with Google's pinned models.

example/example.dart

import 'dart:io';

import 'package:mediapipe_audio/mediapipe_audio.dart';

/// Classifies a 16-bit PCM WAV clip from the command line with Google's pinned
/// YAMNet model: `dart run example/example.dart clip.wav`.
///
/// A Dart program has no app bundle, so this downloads the model once into
/// `.dart_tool/mediapipe_models/`, checks its SHA-256 and passes its path. A
/// Flutter app bundles the model instead, by listing `yamnet` under
/// `hooks.user_defines.mediapipe_audio.models` and running
/// `dart run mediapipe_core:bundle_models`, then passes
/// `model: AudioModels.yamnet`.
Future<void> main(List<String> arguments) async {
  final store = ModelStore(
    cacheDirectory: Directory('.dart_tool/mediapipe_models').absolute.path,
  );
  final model = await store.get(AudioModels.yamnet);
  final classifier = await AudioClassifier.create(
    AudioClassifierOptions(modelPath: model.path, maxResults: 3),
  );
  try {
    final clip = decodeWav(await File(arguments.single).readAsBytes());
    for (final chunk in await classifier.classify(clip)) {
      final labels = chunk.classifications.first.categories
          .map((c) => '${c.categoryName} ${c.score.toStringAsFixed(2)}')
          .join(', ');
      print('${chunk.timestampMilliseconds} ms: $labels');
    }
  } finally {
    await classifier.dispose();
  }
}
2
likes
160
points
773
downloads

Documentation

API reference

Publisher

verified publishergoogle.dev

Weekly Downloads

Google's MediaPipe Audio Classifier (every platform and the web), Audio Transcriber and Text to Speech for Flutter, with Google's pinned models.

Repository (GitHub)
View/report issues
Contributing

Topics

#mediapipe #machine-learning #audio #audio-classification

License

BSD-3-Clause (license)

Dependencies

code_assets, ffi, flutter, flutter_web_plugins, hooks, mediapipe_core, meta, native_toolchain_c, web

More

Packages that depend on mediapipe_audio

Packages that implement mediapipe_audio