transformers-stream-generator

v0.0.5

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers. For more information about how to use this package see README

Latest version published 9 months ago

License: MIT

PyPI

GitHub

Package Health Score

56 / 100

security
Security review needed
popularity
Recognized
maintenance
Inactive
community
Limited

Popularity

Recognized

GitHub Stars: 96
Forks: 14
Contributors: 2

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package transformers-stream-generator, we found that it has been starred 96 times.

Security

Security review needed

Security and license risk for latest version

Release Date: Mar 11, 2024
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
2
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

MIT

Security Policy

We found a way for you to contribute to the project! Looks like transformers-stream-generator is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Inactive

Commit Frequency

Open Issues: 11
Open PR: 0
Last Release: 9 months ago
Last Commit: 9 months ago

Further analysis of the maintenance status of transformers-stream-generator based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Inactive.

We found that transformers-stream-generator demonstrates a positive version release cadence with at least one new version released in the past 12 months.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Community

Limited

Readme: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 2
Funding: No

This project has seen only 10 or less contributors.

We found a way for you to contribute to the project! Looks like transformers-stream-generator is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.5

Age: 2 years
Latest Release: 9 months ago
Dependencies: N/A
Versions: 5
Maintainers: 1
Wheels: No

Readme

transformers-stream-generator

Description

This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.

Web Demo

original
stream

Installation

pip install transformers-stream-generator

Usage

just add two lines of code before your original code

from transformers_stream_generator import init_stream_support
init_stream_support()

add do_stream=True in model.generate function and keep do_sample=True, then you can get a generator

generator = model.generate(input_ids, do_stream=True, do_sample=True)
for token in generator:
    word = tokenizer.decode(token)
    print(word)

Example

run python script example by gpt2
run web example by gpt2 and test in client example

FAQs

What is transformers-stream-generator?

This is a text generation method which returns a generator, streaming out each token in real-time during inference, bas... Visit Snyk Advisor to see a full health score report for transformers-stream-generator, including popularity, security, maintenance & community analysis.

Is transformers-stream-generator popular?

The python package transformers-stream-generator receives a total of 29,056 weekly downloads. As such, transformers-stream-generator popularity was classified as a recognized. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is transformers-stream-generator well maintained?

We found indications that transformers-stream-generator is an Inactive project. See the full package health analysis to learn more about the package maintenance status.

Is transformers-stream-generator safe to use?

While scanning the latest version of transformers-stream-generator, we found that a security review is needed. A total of 0 vulnerabilities or license issues were detected. See the full security scan results.

Last updated on 22 November-2024, at 08:48 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

Package Health Score

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

transformers-stream-generator

Description

Web Demo

Installation

Usage

Example

FAQs

What is transformers-stream-generator?

Is transformers-stream-generator popular?

Is transformers-stream-generator well maintained?

Is transformers-stream-generator safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues