Package Health Score

45 / 100

security
Security review needed
popularity
Small
maintenance
Inactive
community
Sustainable

Explore Similar Packages

requests
96

Popularity

Small

GitHub Stars: 831
Forks: 162
Contributors: 20

Direct Usage Popularity

Based on project statistics from the GitHub repository for the PyPI package scrapyrt-with-params, we found that it has been starred 831 times.

Security

Security review needed

Security and license risk for latest version

Release Date: Apr 12, 2023
Direct Vulnerabilities: 0
C
0
H
0
M
0
L
Indirect Vulnerabilities: 0
C
0
H
0
M
0
L
License Risk: 0
H
2
M
0
L

All security vulnerabilities belong to production dependencies of direct and indirect packages.

License

BSD-3-Clause

Security Policy

We found a way for you to contribute to the project! Looks like scrapyrt-with-params is missing a security policy.

You can connect your project's repository to Snyk to stay up to date on security alerts and receive automatic fix pull requests.

Keep your project free of vulnerabilities with Snyk

Maintenance

Inactive

Commit Frequency

Open Issues: 24
Open PR: 6
Last Release: 2 years ago
Last Commit: 10 months ago

Further analysis of the maintenance status of scrapyrt-with-params based on released PyPI versions cadence, the repository activity, and other data points determined that its maintenance is Inactive.

An important project maintenance signal to consider for scrapyrt-with-params is that it hasn't seen any new versions released to PyPI in the past 12 months, and could be considered as a discontinued project, or that which receives low attention from its maintainers.

In the past month we didn't find any pull request activity or change in issues status has been detected for the GitHub repository.

Community

Sustainable

Readme: Yes
Contributing.md: No
Code of Conduct: No
Contributors: 20
Funding: No

With more than 10 contributors for the scrapyrt-with-params repository, this is possibly a sign for a growing and inviting community.

We found a way for you to contribute to the project! Looks like scrapyrt-with-params is missing a Code of Conduct.

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Ensure all the packages you're using are healthy and well-maintained

Snyk Vulnerability Scanner

Get health score & security insights directly in your IDE

Package

Python Versions Compatibility: >=3.6

Age: 4 years
Latest Release: 2 years ago
Dependencies: 1 Direct / 40 Total
Versions: 3
Maintainers: 1
Wheels: OS Independent

Readme

ScrapyRT (Scrapy realtime)

Add HTTP API for your Scrapy project in minutes.

You send a request to ScrapyRT with spider name and URL, and in response, you get items collected by a spider visiting this URL.

All Scrapy project components (e.g. middleware, pipelines, extensions) are supported
You run Scrapyrt in Scrapy project directory. It starts HTTP server allowing you to schedule spiders and get spider output in JSON.

Quickstart

1. install

&gt; pip install scrapyrt

2. switch to Scrapy project (e.g. quotesbot project)

&gt; cd my/project_path/is/quotesbot

3. launch ScrapyRT

&gt; scrapyrt

4. run your spiders

&gt; curl "localhost:9080/crawl.json?spider_name=toscrape-css&amp;url=http://quotes.toscrape.com/"

5. run more complex query, e.g. specify callback for Scrapy request and zipcode argument for spider

&gt;  curl --data '{"request": {"url": "http://quotes.toscrape.com/page/2/", "callback":"some_callback"}, "spider_name": "toscrape-css", "crawl_args": {"zipcode":"14000"}}' http://localhost:9080/crawl.json -v

Scrapyrt will look for scrapy.cfg file to determine your project settings, and will raise error if it won't find one. Note that you need to have all your project requirements installed.

Note

Project is not a replacement for Scrapyd or Scrapy Cloud or other infrastructure to run long running crawls
Not suitable for long running spiders, good for spiders that will fetch one response from some website and return items quickly

Documentation

Documentation is available on readthedocs.

Support

Open source support is provided here in Github. Please create a question issue (ie. issue with "question" label).

Commercial support is also available by Zyte.

License

ScrapyRT is offered under BSD 3-Clause license.

Development

Development taking place on Github.

scrapyrt-with-params dependencies

scrapy

FAQs

What is scrapyrt-with-params?

Put Scrapy spiders behind an HTTP API. Visit Snyk Advisor to see a full health score report for scrapyrt-with-params, including popularity, security, maintenance & community analysis.

Is scrapyrt-with-params popular?

The python package scrapyrt-with-params receives a total of 45 weekly downloads. As such, scrapyrt-with-params popularity was classified as small. Visit the popularity section on Snyk Advisor to see the full health analysis.

Is scrapyrt-with-params well maintained?

We found indications that scrapyrt-with-params is an Inactive project. See the full package health analysis to learn more about the package maintenance status.

Is scrapyrt-with-params safe to use?

While scanning the latest version of scrapyrt-with-params, we found that a security review is needed. A total of 0 vulnerabilities or license issues were detected. See the full security scan results.

Last updated on 27 November-2024, at 13:24 (UTC).

Build a secure application checklist

Select a recommended open source package

Minimize your risk by selecting secure & well maintained open source packages

DONE

Scan your app for vulnerabilities

Scan your application to find vulnerabilities in your: source code, open source dependencies, containers and configuration files

SCAN NOW

Fix identified vulnerabilities

Easily fix your code by leveraging automatically generated PRs

AUTO FIX

Monitor for new issues

New vulnerabilities are discovered every day. Get notified if your application is affected

MONITOR APP

scrapyrt-with-params

Put Scrapy spiders behind an HTTP API For more information about how to use this package see README

Ensure you're using the healthiest python packages

Package Health Score

Explore Similar Packages

Popularity

Direct Usage Popularity

Security

Security and license risk for latest version

Maintenance

Commit Frequency

Community

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Package

Readme

ScrapyRT (Scrapy realtime)

Quickstart

Note

Documentation

Support

License

Development

scrapyrt-with-params dependencies

FAQs

What is scrapyrt-with-params?

Is scrapyrt-with-params popular?

Is scrapyrt-with-params well maintained?

Is scrapyrt-with-params safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Fix identified vulnerabilities

Monitor for new issues

Package Health Score

Explore Similar Packages

Direct Usage Popularity

Security and license risk for latest version

Commit Frequency

Embed Package Health Score Badge

Keep your project healthy

Check your requirements.txt

Snyk Vulnerability Scanner

Readme

ScrapyRT (Scrapy realtime)

Quickstart

Note

Documentation

Support

License

Development

scrapyrt-with-params dependencies

FAQs

What is scrapyrt-with-params?

Is scrapyrt-with-params popular?

Is scrapyrt-with-params well maintained?

Is scrapyrt-with-params safe to use?

Build a secure application checklist

Select a recommended open source package

Scan your app for vulnerabilities

Source Code

Open Source

Container

Config

Fix identified vulnerabilities

Monitor for new issues