Package Health Score

61 / 100

security
No known security issues
popularity
Small
maintenance
Inactive
community
Active

Popularity

Small

GitHub Stars: 7.96K
Forks: 947
Contributors: 160

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package llama-cpp-guidance, we found that it has been starred 7,962 times.

Security

No known security issues

Security and license risk for latest version

Release Date: Sep 11, 2023
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
0
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

MIT

Security Policy

We found a way for you to contribute to the project! Looks like llama-cpp-guidance is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Inactive

Commit Frequency

Open Issues: 444
Open PR: 71
Last Release: 1 year ago
Last Commit: 2 months ago

Further analysis of the maintenance status of llama-cpp-guidance based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Inactive.

An important project maintenance signal to consider for llama-cpp-guidance is that it hasn't seen any new versions released to PyPI in the past 12 months, and could be considered as a discontinued project, or that which receives low attention from its maintainers.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Community

Active

Readme: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 160
Funding: No

A good and healthy external contribution signal for llama-cpp-guidance project, which invites more than one hundred open source maintainers to collaborate on the repository.

We found a way for you to contribute to the project! Looks like llama-cpp-guidance is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.9,<3.12

Age: 1 year
Latest Release: 1 year ago
Dependencies: 3 Direct
Versions: 3
Maintainers: 1
Wheels: OS Independent

Readme

llama.cpp Guidance

The llama-cpp-guidance package provides an LLM client compatibility layer between llama-cpp-python and guidance.

Installation

The llama-cpp-guidance package can be installed using pip.

pip install llama-cpp-guidance

⚠️ It is highly recommended that you follow the installation instructions for llama-cpp-python after installing llama-cpp-guidance to ensure that you have hardware acceleration setup appropriately.

Basic Usage

Once installed, you can use the LlamaCpp class like any other guidance-compatible LLM class.

from pathlib import Path
from llama_cpp_guidance.llm import LlamaCpp
import guidance

guidance.llm = LlamaCpp(
    model_path=Path("../path/to/llamacpp/model.gguf"),
    n_gpu_layers=1,
    n_threads=8
)

program = guidance(
    "The best thing about the beach is {{~gen 'best' temperature=0.7 max_tokens=10}}"
)
output = program()
print(output)

The best thing about the beach is that there’s always something to do.

llama-cpp-guidance dependencies

guidance llama-cpp-python loguru

FAQs

What is llama-cpp-guidance?

A guidance compatibility layer for llama-cpp-python. Visit Snyk Advisor to see a full health score report for llama-cpp-guidance, including popularity, security, maintenance & community analysis.

Is llama-cpp-guidance popular?

The python package llama-cpp-guidance receives a total of 102 weekly downloads. As such, llama-cpp-guidance popularity was classified as small. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is llama-cpp-guidance well maintained?

We found indications that llama-cpp-guidance is an Inactive project. See the full package health analysis to learn more about the package maintenance status.

Is llama-cpp-guidance safe to use?

The python package llama-cpp-guidance was scanned for known vulnerabilities and missing license, and no issues were found. Thus the package was deemed as safe to use. See the full health analysis review.

Last updated on 20 November-2024, at 21:32 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

llama-cpp-guidance

A guidance compatibility layer for llama-cpp-python For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Readme

llama.cpp Guidance

Installation

Basic Usage

llama-cpp-guidance dependencies

FAQs

What is llama-cpp-guidance?

Is llama-cpp-guidance popular?

Is llama-cpp-guidance well maintained?

Is llama-cpp-guidance safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

llama.cpp Guidance

Installation

Basic Usage

llama-cpp-guidance dependencies

FAQs

What is llama-cpp-guidance?

Is llama-cpp-guidance popular?

Is llama-cpp-guidance well maintained?

Is llama-cpp-guidance safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues