Metadata-Version: 2.1
Name: achatbot
Version: 0.0.5.5
Summary: An open source chat bot for voice (and multimodal) assistants
Author-email: weedge <weege007@gmail.com>
Maintainer-email: weedge <weege007@gmail.com>
License: BSD 3-Clause License
        
        Copyright (c) 2024, weedge
        
        Redistribution and use in source and binary forms, with or without
        modification, are permitted provided that the following conditions are met:
        
        1. Redistributions of source code must retain the above copyright notice, this
           list of conditions and the following disclaimer.
        
        2. Redistributions in binary form must reproduce the above copyright notice,
           this list of conditions and the following disclaimer in the documentation
           and/or other materials provided with the distribution.
        
        3. Neither the name of the copyright holder nor the names of its
           contributors may be used to endorse or promote products derived from
           this software without specific prior written permission.
        
        THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"
        AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE
        IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
        DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE
        FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL
        DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
        SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
        CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,
        OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
        OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
        
Project-URL: Homepage, https://github.com/ai-bot-pro/chat-bot
Project-URL: Documentation, https://github.com/ai-bot-pro/chat-bot/blob/main/docs
Project-URL: Repository, https://github.com/ai-bot-pro/chat-bot.git
Project-URL: Issues, https://github.com/ai-bot-pro/chat-bot/issues
Project-URL: Changelog, https://github.com/ai-bot-pro/chat-bot/blob/main/CHANGELOG.md
Keywords: ai,chat bot,audio,speech
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Topic :: Software Development :: Build Tools
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Multimedia :: Sound/Audio
Classifier: Topic :: Multimedia :: Video
Classifier: License :: OSI Approved :: BSD License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: requests ==2.32.3
Requires-Dist: apipeline ==0.1.7
Requires-Dist: python-dotenv ==1.0.1
Requires-Dist: pydub ==0.25.1
Requires-Dist: pillow ==10.4.0
Requires-Dist: websockets ==12.0
Requires-Dist: aiohttp ==3.10.3
Requires-Dist: scipy ==1.14.0
Requires-Dist: pyloudnorm ==0.1.1
Requires-Dist: numpy ==1.26.4
Requires-Dist: torch ==2.2.2
Requires-Dist: torchaudio ==2.2.2
Requires-Dist: tqdm ==4.66.5
Provides-Extra: ai_frameworks_processor
Requires-Dist: langchain ==0.2.13 ; extra == 'ai_frameworks_processor'
Provides-Extra: asr_processor
Requires-Dist: deepgram-sdk ==3.4.0 ; extra == 'asr_processor'
Requires-Dist: openai-whisper ==20231117 ; extra == 'asr_processor'
Requires-Dist: whisper-timestamped ==1.14.2 ; extra == 'asr_processor'
Requires-Dist: faster-whisper ==1.0.2 ; extra == 'asr_processor'
Requires-Dist: transformers >=4.40.2 ; extra == 'asr_processor'
Requires-Dist: funasr ==1.1.5 ; extra == 'asr_processor'
Requires-Dist: groq ==0.9.0 ; extra == 'asr_processor'
Provides-Extra: conf
Requires-Dist: omegaconf ==2.3.0 ; extra == 'conf'
Provides-Extra: core_llm
Requires-Dist: llama-cpp-python ==0.2.82 ; extra == 'core_llm'
Requires-Dist: geocoder ==1.38.1 ; extra == 'core_llm'
Provides-Extra: daily_room_audio_stream
Requires-Dist: daily-python ==0.10.1 ; extra == 'daily_room_audio_stream'
Provides-Extra: daily_webrtc_terminal_chat_bot
Requires-Dist: daily-python ==0.10.1 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: pvporcupine ==3.0.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: pyannote.audio ==3.2.0 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: torch ==2.2.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: openai-whisper ==20231117 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: whisper-timestamped ==1.14.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: faster-whisper ==1.0.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: transformers >=4.40.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: groq ==0.9.0 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: llama-cpp-python ==0.2.82 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: geocoder ==1.38.1 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: TTS ==0.22.0 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: edge-tts ==6.1.12 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: gTTS ==2.5.1 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: pyttsx3 ==2.90 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: hyperpyyaml ==1.2.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: conformer ==0.3.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: diffusers[torch] ==0.30.0 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: lightning ==2.4.0 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: wget ==3.2 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: vocos ==0.1.0 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: pybase16384 ==0.3.7 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: vector-quantize-pytorch ==1.16.1 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: numpy <2.0.0 ; extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: onnxruntime ==1.18.1 ; (sys_platform == "darwin" or sys_platform == "windows") and extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: onnxruntime-gpu ==1.18.1 ; (sys_platform == "linux") and extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: pynini ==2.1.5 ; (sys_platform == "linux") and extra == 'daily_webrtc_terminal_chat_bot'
Requires-Dist: nemo-text-processing ; (sys_platform == "linux") and extra == 'daily_webrtc_terminal_chat_bot'
Provides-Extra: daily_webrtc_vad_analyzer
Requires-Dist: daily-python ==0.10.1 ; extra == 'daily_webrtc_vad_analyzer'
Provides-Extra: deep_translator
Requires-Dist: deep-translator ==1.11.4 ; extra == 'deep_translator'
Provides-Extra: fastapi_daily_bot_server
Requires-Dist: fastapi ==0.112.0 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: daily-python ==0.10.1 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: langchain ==0.2.13 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: openai ==1.40.6 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: langchain-openai ==0.1.21 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: langchain-community ==0.2.12 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: deepgram-sdk ==3.4.0 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: mangum ==0.17.0 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: uvicorn ==0.30.6 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: tidb-vector ==0.0.10 ; extra == 'fastapi_daily_bot_server'
Requires-Dist: pymysql ==1.1.1 ; extra == 'fastapi_daily_bot_server'
Provides-Extra: grpc
Requires-Dist: grpcio ==1.65.1 ; extra == 'grpc'
Provides-Extra: grpc_tools
Requires-Dist: grpcio-tools ==1.65.1 ; extra == 'grpc_tools'
Provides-Extra: img_processor
Requires-Dist: openai ==1.40.6 ; extra == 'img_processor'
Provides-Extra: llama_cpp
Requires-Dist: llama-cpp-python ==0.2.82 ; extra == 'llama_cpp'
Provides-Extra: llm_personalai_proxy
Requires-Dist: geocoder ==1.38.1 ; extra == 'llm_personalai_proxy'
Provides-Extra: llm_processor
Requires-Dist: openai ==1.40.6 ; extra == 'llm_processor'
Provides-Extra: local_terminal_chat_bot
Requires-Dist: PyAudio ==0.2.14 ; extra == 'local_terminal_chat_bot'
Requires-Dist: pvporcupine ==3.0.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: pyannote.audio ==3.2.0 ; extra == 'local_terminal_chat_bot'
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'local_terminal_chat_bot'
Requires-Dist: torch ==2.2.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: openai-whisper ==20231117 ; extra == 'local_terminal_chat_bot'
Requires-Dist: whisper-timestamped ==1.14.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: faster-whisper ==1.0.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: transformers >=4.40.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: groq ==0.9.0 ; extra == 'local_terminal_chat_bot'
Requires-Dist: funasr ==1.1.5 ; extra == 'local_terminal_chat_bot'
Requires-Dist: llama-cpp-python ==0.2.82 ; extra == 'local_terminal_chat_bot'
Requires-Dist: geocoder ==1.38.1 ; extra == 'local_terminal_chat_bot'
Requires-Dist: TTS ==0.22.0 ; extra == 'local_terminal_chat_bot'
Requires-Dist: edge-tts ==6.1.12 ; extra == 'local_terminal_chat_bot'
Requires-Dist: gTTS ==2.5.1 ; extra == 'local_terminal_chat_bot'
Requires-Dist: pyttsx3 ==2.90 ; extra == 'local_terminal_chat_bot'
Requires-Dist: hyperpyyaml ==1.2.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: conformer ==0.3.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: diffusers[torch] ==0.30.0 ; extra == 'local_terminal_chat_bot'
Requires-Dist: lightning ==2.4.0 ; extra == 'local_terminal_chat_bot'
Requires-Dist: wget ==3.2 ; extra == 'local_terminal_chat_bot'
Requires-Dist: vocos ==0.1.0 ; extra == 'local_terminal_chat_bot'
Requires-Dist: pybase16384 ==0.3.7 ; extra == 'local_terminal_chat_bot'
Requires-Dist: vector-quantize-pytorch ==1.16.1 ; extra == 'local_terminal_chat_bot'
Requires-Dist: numpy <2.0.0 ; extra == 'local_terminal_chat_bot'
Requires-Dist: onnxruntime ==1.18.1 ; (sys_platform == "darwin" or sys_platform == "windows") and extra == 'local_terminal_chat_bot'
Requires-Dist: onnxruntime-gpu ==1.18.1 ; (sys_platform == "linux") and extra == 'local_terminal_chat_bot'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'local_terminal_chat_bot'
Requires-Dist: pynini ==2.1.5 ; (sys_platform == "linux") and extra == 'local_terminal_chat_bot'
Requires-Dist: nemo-text-processing ; (sys_platform == "linux") and extra == 'local_terminal_chat_bot'
Provides-Extra: openai
Requires-Dist: openai ==1.40.6 ; extra == 'openai'
Provides-Extra: porcupine_wakeword
Requires-Dist: pvporcupine ==3.0.2 ; extra == 'porcupine_wakeword'
Provides-Extra: pyannote_vad
Requires-Dist: pyannote.audio ==3.2.0 ; extra == 'pyannote_vad'
Provides-Extra: pyaudio_stream
Requires-Dist: PyAudio ==0.2.14 ; extra == 'pyaudio_stream'
Provides-Extra: pytube
Requires-Dist: pytube ==15.0.0 ; extra == 'pytube'
Provides-Extra: queue
Requires-Dist: redis ==5.0.0 ; extra == 'queue'
Provides-Extra: redis
Requires-Dist: redis ==5.0.0 ; extra == 'redis'
Provides-Extra: remote_grpc_tts_client
Requires-Dist: grpcio ==1.65.1 ; extra == 'remote_grpc_tts_client'
Provides-Extra: remote_grpc_tts_server
Requires-Dist: grpcio ==1.65.1 ; extra == 'remote_grpc_tts_server'
Requires-Dist: TTS ==0.22.0 ; extra == 'remote_grpc_tts_server'
Requires-Dist: edge-tts ==6.1.12 ; extra == 'remote_grpc_tts_server'
Requires-Dist: gTTS ==2.5.1 ; extra == 'remote_grpc_tts_server'
Requires-Dist: pyttsx3 ==2.90 ; extra == 'remote_grpc_tts_server'
Requires-Dist: hyperpyyaml ==1.2.2 ; extra == 'remote_grpc_tts_server'
Requires-Dist: openai-whisper ==20231117 ; extra == 'remote_grpc_tts_server'
Requires-Dist: conformer ==0.3.2 ; extra == 'remote_grpc_tts_server'
Requires-Dist: diffusers[torch] ==0.30.0 ; extra == 'remote_grpc_tts_server'
Requires-Dist: lightning ==2.4.0 ; extra == 'remote_grpc_tts_server'
Requires-Dist: wget ==3.2 ; extra == 'remote_grpc_tts_server'
Requires-Dist: vocos ==0.1.0 ; extra == 'remote_grpc_tts_server'
Requires-Dist: pybase16384 ==0.3.7 ; extra == 'remote_grpc_tts_server'
Requires-Dist: vector-quantize-pytorch ==1.16.1 ; extra == 'remote_grpc_tts_server'
Requires-Dist: transformers >=4.40.2 ; extra == 'remote_grpc_tts_server'
Requires-Dist: numpy <2.0.0 ; extra == 'remote_grpc_tts_server'
Requires-Dist: onnxruntime ==1.18.1 ; (sys_platform == "darwin" or sys_platform == "windows") and extra == 'remote_grpc_tts_server'
Requires-Dist: onnxruntime-gpu ==1.18.1 ; (sys_platform == "linux") and extra == 'remote_grpc_tts_server'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'remote_grpc_tts_server'
Requires-Dist: pynini ==2.1.5 ; (sys_platform == "linux") and extra == 'remote_grpc_tts_server'
Requires-Dist: nemo-text-processing ; (sys_platform == "linux") and extra == 'remote_grpc_tts_server'
Provides-Extra: remote_queue_chat_bot_be_worker
Requires-Dist: redis ==5.0.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: pvporcupine ==3.0.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: pyannote.audio ==3.2.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: torch ==2.2.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: openai-whisper ==20231117 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: whisper-timestamped ==1.14.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: faster-whisper ==1.0.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: transformers >=4.40.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: groq ==0.9.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: funasr ==1.1.5 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: llama-cpp-python ==0.2.82 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: geocoder ==1.38.1 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: TTS ==0.22.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: edge-tts ==6.1.12 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: gTTS ==2.5.1 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: pyttsx3 ==2.90 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: hyperpyyaml ==1.2.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: conformer ==0.3.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: diffusers[torch] ==0.30.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: lightning ==2.4.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: wget ==3.2 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: vocos ==0.1.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: pybase16384 ==0.3.7 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: vector-quantize-pytorch ==1.16.1 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: numpy <2.0.0 ; extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: onnxruntime ==1.18.1 ; (sys_platform == "darwin" or sys_platform == "windows") and extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: onnxruntime-gpu ==1.18.1 ; (sys_platform == "linux") and extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: pynini ==2.1.5 ; (sys_platform == "linux") and extra == 'remote_queue_chat_bot_be_worker'
Requires-Dist: nemo-text-processing ; (sys_platform == "linux") and extra == 'remote_queue_chat_bot_be_worker'
Provides-Extra: remote_queue_chat_bot_fe
Requires-Dist: PyAudio ==0.2.14 ; extra == 'remote_queue_chat_bot_fe'
Requires-Dist: daily-python ==0.10.1 ; extra == 'remote_queue_chat_bot_fe'
Requires-Dist: redis ==5.0.0 ; extra == 'remote_queue_chat_bot_fe'
Provides-Extra: remote_rpc_chat_bot_be_worker
Requires-Dist: grpcio ==1.65.1 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: pvporcupine ==3.0.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: pyannote.audio ==3.2.0 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: torch ==2.2.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: openai-whisper ==20231117 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: whisper-timestamped ==1.14.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: faster-whisper ==1.0.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: transformers >=4.40.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: groq ==0.9.0 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: funasr ==1.1.5 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: llama-cpp-python ==0.2.82 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: geocoder ==1.38.1 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: TTS ==0.22.0 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: edge-tts ==6.1.12 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: gTTS ==2.5.1 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: pyttsx3 ==2.90 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: hyperpyyaml ==1.2.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: conformer ==0.3.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: diffusers[torch] ==0.30.0 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: lightning ==2.4.0 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: wget ==3.2 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: vocos ==0.1.0 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: pybase16384 ==0.3.7 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: vector-quantize-pytorch ==1.16.1 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: numpy <2.0.0 ; extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: onnxruntime ==1.18.1 ; (sys_platform == "darwin" or sys_platform == "windows") and extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: onnxruntime-gpu ==1.18.1 ; (sys_platform == "linux") and extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: pynini ==2.1.5 ; (sys_platform == "linux") and extra == 'remote_rpc_chat_bot_be_worker'
Requires-Dist: nemo-text-processing ; (sys_platform == "linux") and extra == 'remote_rpc_chat_bot_be_worker'
Provides-Extra: remote_rpc_chat_bot_fe
Requires-Dist: PyAudio ==0.2.14 ; extra == 'remote_rpc_chat_bot_fe'
Requires-Dist: daily-python ==0.10.1 ; extra == 'remote_rpc_chat_bot_fe'
Requires-Dist: grpcio ==1.65.1 ; extra == 'remote_rpc_chat_bot_fe'
Provides-Extra: rms_recorder
Provides-Extra: rpc
Requires-Dist: grpcio ==1.65.1 ; extra == 'rpc'
Provides-Extra: sense_voice_asr
Requires-Dist: funasr ==1.1.5 ; extra == 'sense_voice_asr'
Provides-Extra: silero_vad
Requires-Dist: torch ==2.2.2 ; extra == 'silero_vad'
Provides-Extra: silero_vad_analyzer
Requires-Dist: torch ==2.2.2 ; extra == 'silero_vad_analyzer'
Provides-Extra: speech_asr
Requires-Dist: openai-whisper ==20231117 ; extra == 'speech_asr'
Requires-Dist: whisper-timestamped ==1.14.2 ; extra == 'speech_asr'
Requires-Dist: faster-whisper ==1.0.2 ; extra == 'speech_asr'
Requires-Dist: transformers >=4.40.2 ; extra == 'speech_asr'
Requires-Dist: groq ==0.9.0 ; extra == 'speech_asr'
Provides-Extra: speech_audio_stream
Requires-Dist: PyAudio ==0.2.14 ; extra == 'speech_audio_stream'
Requires-Dist: daily-python ==0.10.1 ; extra == 'speech_audio_stream'
Provides-Extra: speech_tts
Requires-Dist: TTS ==0.22.0 ; extra == 'speech_tts'
Requires-Dist: edge-tts ==6.1.12 ; extra == 'speech_tts'
Requires-Dist: gTTS ==2.5.1 ; extra == 'speech_tts'
Requires-Dist: pyttsx3 ==2.90 ; extra == 'speech_tts'
Requires-Dist: hyperpyyaml ==1.2.2 ; extra == 'speech_tts'
Requires-Dist: openai-whisper ==20231117 ; extra == 'speech_tts'
Requires-Dist: conformer ==0.3.2 ; extra == 'speech_tts'
Requires-Dist: diffusers[torch] ==0.30.0 ; extra == 'speech_tts'
Requires-Dist: lightning ==2.4.0 ; extra == 'speech_tts'
Requires-Dist: wget ==3.2 ; extra == 'speech_tts'
Requires-Dist: vocos ==0.1.0 ; extra == 'speech_tts'
Requires-Dist: pybase16384 ==0.3.7 ; extra == 'speech_tts'
Requires-Dist: vector-quantize-pytorch ==1.16.1 ; extra == 'speech_tts'
Requires-Dist: transformers >=4.40.2 ; extra == 'speech_tts'
Requires-Dist: numpy <2.0.0 ; extra == 'speech_tts'
Requires-Dist: onnxruntime ==1.18.1 ; (sys_platform == "darwin" or sys_platform == "windows") and extra == 'speech_tts'
Requires-Dist: onnxruntime-gpu ==1.18.1 ; (sys_platform == "linux") and extra == 'speech_tts'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'speech_tts'
Requires-Dist: pynini ==2.1.5 ; (sys_platform == "linux") and extra == 'speech_tts'
Requires-Dist: nemo-text-processing ; (sys_platform == "linux") and extra == 'speech_tts'
Provides-Extra: speech_vad
Requires-Dist: pyannote.audio ==3.2.0 ; extra == 'speech_vad'
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'speech_vad'
Requires-Dist: torch ==2.2.2 ; extra == 'speech_vad'
Provides-Extra: speech_waker
Requires-Dist: pvporcupine ==3.0.2 ; extra == 'speech_waker'
Provides-Extra: stream_player
Provides-Extra: test
Requires-Dist: sentence-transformers ==3.0.0 ; extra == 'test'
Provides-Extra: tts_chat
Requires-Dist: vocos ==0.1.0 ; extra == 'tts_chat'
Requires-Dist: pybase16384 ==0.3.7 ; extra == 'tts_chat'
Requires-Dist: vector-quantize-pytorch ==1.16.1 ; extra == 'tts_chat'
Requires-Dist: transformers >=4.40.2 ; extra == 'tts_chat'
Requires-Dist: numpy <2.0.0 ; extra == 'tts_chat'
Requires-Dist: pynini ==2.1.5 ; (sys_platform == "linux") and extra == 'tts_chat'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'tts_chat'
Requires-Dist: nemo-text-processing ; (sys_platform == "linux") and extra == 'tts_chat'
Provides-Extra: tts_coqui
Requires-Dist: TTS ==0.22.0 ; extra == 'tts_coqui'
Provides-Extra: tts_cosy_voice
Requires-Dist: hyperpyyaml ==1.2.2 ; extra == 'tts_cosy_voice'
Requires-Dist: openai-whisper ==20231117 ; extra == 'tts_cosy_voice'
Requires-Dist: conformer ==0.3.2 ; extra == 'tts_cosy_voice'
Requires-Dist: diffusers[torch] ==0.30.0 ; extra == 'tts_cosy_voice'
Requires-Dist: lightning ==2.4.0 ; extra == 'tts_cosy_voice'
Requires-Dist: wget ==3.2 ; extra == 'tts_cosy_voice'
Requires-Dist: onnxruntime ==1.18.1 ; (sys_platform == "darwin" or sys_platform == "windows") and extra == 'tts_cosy_voice'
Requires-Dist: onnxruntime-gpu ==1.18.1 ; (sys_platform == "linux") and extra == 'tts_cosy_voice'
Requires-Dist: WeTextProcessing ==1.0.4.1 ; (sys_platform == "linux") and extra == 'tts_cosy_voice'
Provides-Extra: tts_edge
Requires-Dist: edge-tts ==6.1.12 ; extra == 'tts_edge'
Provides-Extra: tts_g
Requires-Dist: gTTS ==2.5.1 ; extra == 'tts_g'
Provides-Extra: tts_processor
Requires-Dist: openai ==1.40.6 ; extra == 'tts_processor'
Provides-Extra: tts_pyttsx3
Requires-Dist: pyttsx3 ==2.90 ; extra == 'tts_pyttsx3'
Provides-Extra: vad_recorder
Requires-Dist: pyannote.audio ==3.2.0 ; extra == 'vad_recorder'
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'vad_recorder'
Requires-Dist: torch ==2.2.2 ; extra == 'vad_recorder'
Provides-Extra: webrtc_silero_vad
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'webrtc_silero_vad'
Requires-Dist: torch ==2.2.2 ; extra == 'webrtc_silero_vad'
Provides-Extra: webrtcvad
Requires-Dist: webrtcvad ==2.0.10 ; extra == 'webrtcvad'
Provides-Extra: whisper_asr
Requires-Dist: openai-whisper ==20231117 ; extra == 'whisper_asr'
Provides-Extra: whisper_faster_asr
Requires-Dist: faster-whisper ==1.0.2 ; extra == 'whisper_faster_asr'
Provides-Extra: whisper_groq_asr
Requires-Dist: groq ==0.9.0 ; extra == 'whisper_groq_asr'
Provides-Extra: whisper_mlx_asr
Requires-Dist: mlx-whisper ==0.2.0 ; (sys_platform == "darwin" and platform_machine == "arm64") and extra == 'whisper_mlx_asr'
Provides-Extra: whisper_timestamped_asr
Requires-Dist: whisper-timestamped ==1.14.2 ; extra == 'whisper_timestamped_asr'
Provides-Extra: whisper_transformers_asr
Requires-Dist: transformers >=4.40.2 ; extra == 'whisper_transformers_asr'

# chat-bot
[![PyPI](https://img.shields.io/pypi/v/achatbot)](https://pypi.org/project/achatbot/)

# Install
## pypi
```
python3 -m venv .venv_achatbot
source .venv_achatbot/bin/activate
pip install achatbot
# optional-dependencies e.g.
pip install "achatbot[fastapi_daily_bot_server]"
```

## local
```
git clone https://github.com/ai-bot-pro/chat-bot.git
cd chat-bot
bash scripts/pypi_achatbot.sh dev
# optional-dependencies e.g.
pip install "dist/achatbot-{$verion}-py3-none-any.whl[fastapi_daily_bot_server]"
```

#  Run chat bots
## Run local chat bots
> [!NOTE]
> - PyAudio need install python3-pyaudio 
> e.g. ubuntu `apt-get install python3-pyaudio`, macos `brew install portaudio`
> see: https://pypi.org/project/PyAudio/
>
> - llm llama-cpp-python init use cpu Pre-built Wheel to install, 
> if want to use other lib(cuda), see: https://github.com/abetlen/llama-cpp-python#installation-configuration
>

1. run `pip install "achatbot[local_terminal_chat_bot]"` to install dependencies to run local terminal chat bot;
2. create achatbot data dir in `$HOME` dir `mkdir -p ~/.achatbot/{log,config,models,records,videos}`;
3. `cp .env.example .env`, and check `.env`, add key/value env params;
4. select a model ckpt to download:
    - vad model ckpt (default vad ckpt model use [silero vad](https://github.com/snakers4/silero-vad))
    ```
    # vad pyannote segmentation ckpt
    huggingface-cli download pyannote/segmentation-3.0  --local-dir ~/.achatbot/models/pyannote/segmentation-3.0 --local-dir-use-symlinks False
    ```
    - asr model ckpt (default whipser ckpt model use base size)
    ```
    # asr openai whisper ckpt
    wget https://openaipublic.azureedge.net/main/whisper/~/.achatbot/models/ed3a0b6b1c0edf879ad9b11b1af5a0e6ab5db9205f891f668f8b0e6c6326e34e/base.pt -O ~/.achatbot/models/base.pt

    # asr hf openai whisper ckpt for transformers pipeline to load
    huggingface-cli download openai/whisper-base  --local-dir ~/.achatbot/models/openai/whisper-base --local-dir-use-symlinks False

    # asr hf faster whisper (CTranslate2)
    huggingface-cli download Systran/faster-whisper-base  --local-dir ~/.achatbot/models/Systran/faster-whisper-base --local-dir-use-symlinks False

    # asr SenseVoice ckpt
    huggingface-cli download FunAudioLLM/SenseVoiceSmall  --local-dir ~/.achatbot/models/FunAudioLLM/SenseVoiceSmall --local-dir-use-symlinks False
    ```
    - llm model ckpt (default llamacpp ckpt(ggml) model use qwen-2 instruct 1.5B size)
    ```
    # llm llamacpp Qwen2-Instruct
    huggingface-cli download Qwen/Qwen2-1.5B-Instruct-GGUF qwen2-1_5b-instruct-q8_0.gguf  --local-dir ~/.achatbot/models --local-dir-use-symlinks False

    # llm llamacpp Qwen1.5-chat
    huggingface-cli download Qwen/Qwen1.5-7B-Chat-GGUF qwen1_5-7b-chat-q8_0.gguf  --local-dir ~/.achatbot/models --local-dir-use-symlinks False

    # llm llamacpp phi-3-mini-4k-instruct
    huggingface-cli download microsoft/Phi-3-mini-4k-instruct-gguf Phi-3-mini-4k-instruct-q4.gguf --local-dir ~/.achatbot/models --local-dir-use-symlinks False

    ```
    - tts model ckpt (default whipser ckpt model use base size)
    ```
    # tts chatTTS
    !huggingface-cli download 2Noise/ChatTTS  --local-dir ~/.achatbot/models/2Noise/ChatTTS --local-dir-use-symlinks False
    
    # tts coquiTTS
    !huggingface-cli download coqui/XTTS-v2  --local-dir ~/.achatbot/models/coqui/XTTS-v2 --local-dir-use-symlinks False
    
    # tts cosy voice
    git lfs install
    git clone https://www.modelscope.cn/iic/CosyVoice-300M.git ~/.achatbot/models/CosyVoice-300M
    git clone https://www.modelscope.cn/iic/CosyVoice-300M-SFT.git ~/.achatbot/models/CosyVoice-300M-SFT
    git clone https://www.modelscope.cn/iic/CosyVoice-300M-Instruct.git ~/.achatbot/models/CosyVoice-300M-Instruct
    #git clone https://www.modelscope.cn/iic/CosyVoice-ttsfrd.git ~/.achatbot/models/CosyVoice-ttsfrd
    
    ```

5. run local terminal chat bot with env; e.g. 
    - use dufault env params to run local chat bot
    ```
    ACHATBOT_PKG=1 TQDM_DISABLE=True \
        python -m achatbot.cmd.local-terminal-chat.generate_audio2audio > ~/.achatbot/log/std_out.log
    ```

## Run remote http fastapi daily chat bots
1. run `pip install "achatbot[fastapi_daily_bot_server]"` to install dependencies to run http fastapi daily chat bot; 

2. run below cmd to start http server, see api docs: http://0.0.0.0:4321/docs
    ```
    ACHATBOT_PKG=1 python -m achatbot.cmd.http.server.fastapi_daily_bot_serve
    ```
3. run chat bot processor, e.g. 
   - run a daily langchain rag bot api, with ui/educator-client
> [!NOTE]
> need process youtube audio save to local file with `pytube`, run `pip install "achatbot[pytube,deep_translator]"` to install dependencies
> and transcribe/translate to text, then chunks to vector store, and run langchain rag bot api;
   > run data process: 
    ```
    ACHATBOT_PKG=1 python -m achatbot.cmd.bots.rag.data_process.youtube_audio_transcribe_to_tidb
    ```
   > or download processed data from hf dataset [weege007/youtube_videos](https://huggingface.co/datasets/weege007/youtube_videos/tree/main/videos), then chunks to vector store .
   ```
   curl -XPOST "http://0.0.0.0:4321/bot_join/chat-bot/DailyLangchainRAGBot" \
    -H "Content-Type: application/json" \
    -d $'{"config":{"llm":{"model":"llama-3.1-70b-versatile","messages":[{"role":"system","content":""}],"language":"zh"},"tts":{"tag":"cartesia_tts_processor","args":{"voice_id":"eda5bbff-1ff1-4886-8ef1-4e69a77640a0","language":"zh"}},"asr":{"tag":"deepgram_asr_processor","args":{"language":"zh","model":"nova-2"}}}}' | jq .
   ```
   - run a daily rtvi chat bot api, with ui/rtvi-web-demo
   ```
   curl -XPOST "http://0.0.0.0:4321/bot_join/DailyRTVIBot" \
    -H "Content-Type: application/json" \
    -d $'{"config":{"llm":{"model":"llama-3.1-70b-versatile","messages":[{"role":"system","content":"You are ai assistant. Answer in 1-5 sentences. Be friendly, helpful and concise. Default to metric units when possible. Keep the conversation short and sweet. You only answer in raw text, no markdown format. Don\'t include links or any other extras"}]},"tts":{"voice":"2ee87190-8f84-4925-97da-e52547f9462c"}}}' | jq .

   curl -XPOST "http://0.0.0.0:4321/bot_join/DailyAsrRTVIBot" \
    -H "Content-Type: application/json" \
    -d $'{"config":{"llm":{"model":"llama-3.1-70b-versatile","messages":[{"role":"system","content":"你是一位很有帮助中文AI助理机器人。你的目标是用简洁的方式展示你的能力,请用中文简短回答，回答限制在1-5句话内。你的输出将转换为音频，所以不要在你的答案中包含特殊字符。以创造性和有帮助的方式回应用户说的话。"}]},"tts":{"voice":"2ee87190-8f84-4925-97da-e52547f9462c"}}}' | jq .
   ```

## Run remote rpc chat bot worker
1. run `pip install "achatbot[remote_rpc_chat_bot_be_worker]"` to install dependencies to run rpc chat bot BE worker; e.g. :
   - use dufault env params to run rpc chat bot BE worker
```
ACHATBOT_PKG=1 RUN_OP=be TQDM_DISABLE=True \
    TTS_TAG=tts_edge \
    python -m achatbot.cmd.grpc.terminal-chat.generate_audio2audio > ~/.achatbot/log/be_std_out.log
```
2. run `pip install "achatbot[remote_rpc_chat_bot_fe]"` to install dependencies to run rpc chat bot FE; 
```
ACHATBOT_PKG=1 RUN_OP=fe \
    TTS_TAG=tts_edge \
    python -m achatbot.cmd.grpc.terminal-chat.generate_audio2audio > ~/.achatbot/log/fe_std_out.log
```

## Run remote queue chat bot worker
1. run `pip install "achatbot[remote_queue_chat_bot_be_worker]"` to install dependencies to run queue chat bot worker; e.g.:
   - use default env params to run 
    ```
    ACHATBOT_PKG=1 REDIS_PASSWORD=$redis_pwd RUN_OP=be TQDM_DISABLE=True \
        python -m achatbot.cmd.remote-queue-chat.generate_audio2audio > ~/.achatbot/log/be_std_out.log
    ```
   - sense_voice (asr) -> qwen (llm) -> cosy_voice (tts)
   ```
    ACHATBOT_PKG=1 RUN_OP=be \
        TQDM_DISABLE=True \
        REDIS_PASSWORD=$redis_pwd \
        ASR_TAG=sense_voice_asr \
        ASR_LANG=zn \
        N_GPU_LAYERS=33 FLASH_ATTN=1 \
        LLM_MODEL_NAME=qwen \
        LLM_MODEL_PATH=./models/qwen1_5-7b-chat-q8_0.gguf \
        ASR_MODEL_NAME_OR_PATH=./models/FunAudioLLM/SenseVoiceSmall \
        TTS_TAG=tts_cosy_voice \
        python -m achatbot.cmd.remote-queue-chat.generate_audio2audio > ~/.achatbot/log/be_std_out.log
   ```
2. run `pip install "achatbot[remote_queue_chat_bot_fe]"` to install the required packages to run quueue chat bot frontend; e.g.:
   - use default env params to run 
    ```
    ACHATBOT_PKG=1 REDIS_PASSWORD=$redis_pwd RUN_OP=fe \
        python -m achatbot.cmd.remote-queue-chat.generate_audio2audio > ~/.achatbot/log/fe_std_out.log
    ```
   - with wake word
    ```
    ACHATBOT_PKG=1 REDIS_PASSWORD=$redis_pwd RUN_OP=fe \
        RECORDER_TAG=wakeword_rms_recorder \
        python -m achatbot.cmd.remote-queue-chat.generate_audio2audio > ~/.achatbot/log/fe_std_out.log
    ```

## Run remote grpc tts speaker bot
1. run `pip install "achatbot[remote_grpc_tts_server]"` to install dependencies to run grpc tts speaker bot server; 
```
ACHATBOT_PKG=1 python -m achatbot.cmd.grpc.speaker.server.serve
```
2. run `pip install "achatbot[remote_grpc_tts_client]"` to install dependencies to run grpc tts speaker bot client; 
```
ACHATBOT_PKG=1 TTS_TAG=tts_edge python -m achatbot.cmd.grpc.speaker.client
ACHATBOT_PKG=1 TTS_TAG=tts_g IS_RELOAD=1 python -m achatbot.cmd.grpc.speaker.client
ACHATBOT_PKG=1 TTS_TAG=tts_coqui IS_RELOAD=1 python -m achatbot.cmd.grpc.speaker.client
ACHATBOT_PKG=1 TTS_TAG=tts_chat IS_RELOAD=1 python -m achatbot.cmd.grpc.speaker.client
ACHATBOT_PKG=1 TTS_TAG=tts_cosy_voice IS_RELOAD=1 python -m achatbot.cmd.grpc.speaker.client
```


# Project Structure
![project-structure](https://github.com/user-attachments/assets/5bf7cebb-e590-4718-a78a-6b0c0b36ea28)


## audio (voice)
- stream-stt (realtime-recorder)
![audio-text](https://github.com/user-attachments/assets/44bcec7d-f0a1-47db-bd95-21feee43a361)

- audio-llm (multimode-chat)
![pipe](https://github.com/user-attachments/assets/9970cf18-9bbc-4109-a3c5-e3e3c88086af)
![queue](https://github.com/user-attachments/assets/30f2e880-f16d-4b62-8668-61bb97c57b2b)


- stream-tts (realtime-(clone)-speaker)
![text-audio](https://github.com/user-attachments/assets/676230a0-0a99-475b-9ef5-6afc95f044d8)
![audio-text text-audio](https://github.com/user-attachments/assets/cbcabf98-731e-4887-9f37-649ec81e37a0)


## vision (CV)
- stream-ocr (realtime-object-dectection)

## more
- Embodied Intelligence: Robots that touch the world, perceive and move
