#72027 - [PATCH] gnu: Add whisper-cpp.

Package	Source(s)		Maintainer(s)
guix-patches		PTS Buildd Popcon

Message #38 received at 72027@debbugs.gnu.org (full text, mbox, reply):

Received: (at 72027) by debbugs.gnu.org; 25 Sep 2024 02:41:31 +0000
From debbugs-submit-bounces@debbugs.gnu.org Tue Sep 24 22:41:31 2024
Received: from localhost ([127.0.0.1]:33944 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces@debbugs.gnu.org>)
	id 1stHy6-0007Ma-UD
	for submit@debbugs.gnu.org; Tue, 24 Sep 2024 22:41:31 -0400
Received: from mail-pl1-f174.google.com ([209.85.214.174]:47429)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <lichengtai@gmail.com>) id 1stHy5-0007MD-7v
 for 72027@debbugs.gnu.org; Tue, 24 Sep 2024 22:41:29 -0400
Received: by mail-pl1-f174.google.com with SMTP id
 d9443c01a7336-2053a0bd0a6so62445425ad.3
 for <72027@debbugs.gnu.org>; Tue, 24 Sep 2024 19:41:03 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20230601; t=1727231998; x=1727836798; darn=debbugs.gnu.org;
 h=content-transfer-encoding:mime-version:message-id:date:subject:cc
 :to:from:sender:from:to:cc:subject:date:message-id:reply-to;
 bh=+Lt8QLHd62fcJgU4D/JDZ3fe2fGlhu7EP3FU8Z/pvg8=;
 b=HcOmIwoRjW5i5CxPGGFJqYvRgw30DJ7te0PYyFFD+WsHTWkzUf2ntqF29kBBjbsB4q
 wnOI5znMg9IgJuGjBCMR5a83IcMQ6Uf5bvky0fa4SlMsYp/MhoCxt/yv5zqzJ7msF+T0
 DedcLOqG8jlGkgduU+NjAWtz6bwJmHIJ5dM3WpnO5oH4eC6FuesaNmAaRMTrIn4ZuOfc
 LSiQFdELfWjykS1krvbL946jbLNO4WWNL+5AMRnmDvWidPY0/fEbgQ+BoIdSbD8JGB3D
 TtmUdjvHAZndIezqXetwVTgwml905LJT9ZtJ09/Ft189rkciw5/+pOLD2FMr7xacXXGl
 wUAQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1727231998; x=1727836798;
 h=content-transfer-encoding:mime-version:message-id:date:subject:cc
 :to:from:sender:x-gm-message-state:from:to:cc:subject:date
 :message-id:reply-to;
 bh=+Lt8QLHd62fcJgU4D/JDZ3fe2fGlhu7EP3FU8Z/pvg8=;
 b=TqtVPtG6QF4LhgViskibcNjPMwFHpmB62q5GoIzz5mZOBHkh+PpM5OITQiDMfMFWsP
 sBTlAQGxoPDpUBiSzfTG2jr9gYg+v64bXepsZJgw0/MauZOpZZMATHqOnu80Nuwi009i
 sP2nencXQtZ48wNVJsx/FVNtLGIpwng46Kfu40UzsNA0ycZotf1ExGG5G+EVT52iq77j
 mScCwmjhUUJi25TZQp9Z4UqyEU+OFe1aZaN/FT3nCQ7VyClpPfz0yk9stxeGYpwqnsT+
 9G7UYUiHmajbxpjwclflFZnU6JyWkCpCR7i6pIyc0sgEQYog/43K1jjUwtrNSOGMDymd
 CeVw==
X-Gm-Message-State: AOJu0Yyo7SILvbjeEoOVnIa2zJgyaSrDdwJGVWu/NYgesGKuNwZ90tAv
 hhD1hDyOCixX5JygbOI/st8i3n1GGkZha6qt0wg6fQ89Dh4jxfL2bIU3Yg==
X-Google-Smtp-Source: AGHT+IHDTSFxVBilett2abZ0jZFxHuyalj+OP5ZeJmxXybEzO3efhd7wQOwZy3m7p3Ge/tts792W5w==
X-Received: by 2002:a17:902:e742:b0:1fc:6a13:a394 with SMTP id
 d9443c01a7336-20afc468f9cmr16434205ad.23.1727231997828; 
 Tue, 24 Sep 2024 19:39:57 -0700 (PDT)
Received: from DEskMiniX300.. ([38.84.157.61])
 by smtp.gmail.com with ESMTPSA id
 d9443c01a7336-20af17e1ab8sm15728485ad.121.2024.09.24.19.39.56
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Tue, 24 Sep 2024 19:39:57 -0700 (PDT)
From: Andy Tai <atai@atai.org>
To: 72027@debbugs.gnu.org
Subject: [PATCH v8] gnu: Add whisper-cpp.
Date: Tue, 24 Sep 2024 19:39:54 -0700
Message-Id: <5e060d6337c96c9cd1b8255fc85e424680fcc119.1727231962.git.atai@atai.org>
X-Mailer: git-send-email 2.34.1
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
X-Spam-Score: 0.2 (/)
X-Debbugs-Envelope-To: 72027
Cc: Andy Tai <atai@atai.org>
X-BeenThere: debbugs-submit@debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request@debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit@debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request@debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request@debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces@debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces@debbugs.gnu.org>
X-Spam-Score: -0.8 (/)

* gnu/packages/machine-learning.scm (whisper-cpp): New variable.

Change-Id: I8db67dc543c0a1280e2cc5e8c03945b9ccdb9975
---
 gnu/packages/machine-learning.scm | 52 +++++++++++++++++++++++++++++++
 1 file changed, 52 insertions(+)

diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm
index 5d34283947..013d740673 100644
--- a/gnu/packages/machine-learning.scm
+++ b/gnu/packages/machine-learning.scm
@@ -118,6 +118,7 @@ (define-module (gnu packages machine-learning)
   #:use-module (gnu packages rdf)
   #:use-module (gnu packages regex)
   #:use-module (gnu packages rpc)
+  #:use-module (gnu packages sdl)
   #:use-module (gnu packages serialization)
   #:use-module (gnu packages sphinx)
   #:use-module (gnu packages statistics)
@@ -6067,6 +6068,57 @@ (define-public oneapi-dnnl-for-r-torch
        (sha256
         (base32 "1zyw5rd8x346bb7gac9a7x3saviw3zvp6aqz2z1l9sv163vmjfz6"))))))
 
+(define-public whisper-cpp
+  (package
+    (name "whisper-cpp")
+    (version "1.6.2")
+    (source
+     (origin
+       (method git-fetch)
+       (uri (git-reference
+             (url "https://github.com/ggerganov/whisper.cpp")
+             (commit (string-append "v" version))))
+       (file-name (git-file-name name version))
+       (sha256
+        (base32 "01q4j602wkvsf9vw0nsazzgvjppf4fhpy90vqnm9affynyxhi0c4"))))
+    (build-system cmake-build-system)
+    (arguments
+     (list
+      #:configure-flags #~'("-DWHISPER_STANDALONE=TRUE" "-DWHISPER_SDL2=TRUE")
+      ;; "-DWHISPER_FFMPEG=TRUE"  ; TODO
+      #:phases #~(modify-phases %standard-phases
+           #$@(if (not (target-64bit?))
+                  '((add-after 'unpack 'skip-failing-tests
+                     (lambda _
+                              ;; 32-bit system
+                              ;; large model does not fit in RAM in 32-bit system,
+                              ;; disable large model test
+                              (substitute* "tests/CMakeLists.txt"
+                                  (("LABELS \"large\"")
+                                   "DISABLED true")))))
+                  '()))))
+    (inputs (list sdl2)) ;ffmpeg openblas  ;TODO:
+    (native-inputs (list pkg-config))
+    (properties '((tunable? . #t))) ;use AVX512, FMA, etc. when available
+    (home-page "https://github.com/ggerganov/whisper.cpp")
+    (synopsis "OpenAI's Whisper model in C/C++")
+    (description
+     "This package is a high-performance inference of OpenAI's
+Whisper automatic speech recognition (ASR) model, implemented in plain C/C++
+without dependencies, with
+@itemize
+@item AVX intrinsics support for x86 architectures
+@item VSX intrinsics support for POWER architectures
+@item Mixed F16 / F32 precision
+@item 4-bit and 5-bit integer quantization support
+@item Zero memory allocations at runtime
+@item Support for CPU-only inference
+@item Efficient GPU support for NVIDIA
+@item OpenVINO Support
+@item C-style API
+@end itemize")
+    (license license:expat)))
+
 (define-public python-gguf
   (package
     (name "python-gguf")

base-commit: 3ac69c1a757430d6dfdd37eb948ba1d6967967cc
-- 
2.34.1

Display info messages

Send a report that this bug log contains spam.

debbugs.gnu.org maintainers <help-debbugs@gnu.org>. Last modified: Fri Oct 25 19:22:28 2024; Machine Name: wallace-server

GNU bug tracking system

Debbugs is free software and licensed under the terms of the GNU Public License version 2. The current version can be obtained from https://bugs.debian.org/debbugs-source/.

#72027 [PATCH] gnu: Add whisper-cpp.