整理汇总Python框架、库以及软件资源

本文涉及的产品
Redis 开源版,标准版 2GB
推荐场景:
搭建游戏排行榜
RDS MySQL Serverless 基础系列,0.5-2RCU 50GB
云数据库 MongoDB,独享型 2核8GB
推荐场景:
构建全方位客户视图
简介:

很多来自世界各地的程序员不求回报的写代码为别人造轮子、贡献代码、开发框架。开放源代码使得分散在世界各地的程序员们都能够贡献他们的代码与创新。

Python就是这样一门受到全世界各地开源社区支持的语言。Python可以用来开发各种小工具软件、web应用、科学计算、数据分析等等,Python拥有大量的流行框架,比如Django。使用Python框架时,可以根据自己的需求插入不同的模块,比如可以用Scrapy来实现网络爬虫,可以用SciPy来进行科学计算。

Python很多模块框架都拥有来自社区良好的支持与维护。

Python是一门非常受欢迎的编程语言,最近甚至成为了美国很多大学最受欢迎的编程语言。

下面的这个列表是由程序员的资料库从网络上收集的有个Python的资源




Environment Management

Libraries for Python version and environment management.

  • pyenv – Simple Python version management.

  • virtualenv – A tool to create isolated Python environments.

  • virtualenvwrapper – A set of extensions to virtualenv

  • pew – A set of tools to manage multiple virtual environments.

  • Vex – Run a command in the named virtualenv.

  • PyRun – A one-file, no-installation-needed version of Python.

Package Management

Libraries for package and dependency management.

  • pip – The Python package and dependency manager.

  • conda – Cross-platform, Python-agnostic binary package manager.

  • Curdling – Curdling is a command line tool for managing Python packages.

  • wheel – The new standard of Python distribution and are intended to replace eggs.

Distribution

Libraries to create packaged executables for release distribution.

  • cx-Freeze – Freezes Python scripts (cross-platform)

  • py2exe – Freezes Python scripts (Windows)

  • py2app – Freezes Python scripts (Mac OS X)

  • PyInstaller – A program that converts Python programs into stand-alone executables (Windows, Linux, Mac OS X, Solaris and AIX)

  • dh-virtualenv – Build and distribute a virtualenv as a Debian package.

Build Tools

Compile software from source code.

  • buildout – A build system for creating, assembling and deploying applications from multiple parts, some of which may be non-Python-based.

  • SCons – A software construction tool.

  • PlatformIO – A console tool to build code with different development platforms.

  • BitBake – A make-like build tool with the special focus of distributions and packages for embedded Linux.

  • fabricate – A build tool that finds dependencies automatically for any language.

Interactive Interpreter

Interactive Python interpreters.

  • IPython – IPython provides a rich toolkit to help you make the most out of using Python interactively.

  • bpython – A fancy interface to the Python interpreter for Linux, BSD, OS X and Windows (with some work).

Files

Libraries for file manipulation and MIME type detection.

  • mimetypes – (Python standard library) Map filenames to MIME types.

  • imghdr – (Python standard library) Determine the type of an image.

  • python-magic – A Python interface to the libmagic file type identification library.

  • path.py – A module wrapper for os.path.

  • watchdog – API and shell utilities to monitor file system events.

  • Unipath – An object-oriented approach to file/directory operations.

  • pathlib – An cross-platform, object-oriented path library (included in Python 3.4)

Date and Time

Libraries for working with dates and times.

  • arrow – Better dates & times for Python.

  • dateutil – Extensions to the standard Python datetime module.

  • delorean – A library for clearing up the inconvenient truths that arise dealing with datetimes in Python.

  • when.py – Providing user-friendly functions to help perform common date and time actions.

  • moment – A Python library for dealing with dates/times. Inspired by Moment.js.

  • pytz – World timezone definitions, modern and historical. Brings the Olson tz database into Python.

Text Processing

Libraries for parsing and manipulating texts.

  • General

    • difflib – (Python standard library) Helpers for computing deltas.

    • Levenshtein – Fast computation of Levenshtein distance and string similarity.

    • fuzzywuzzy – Fuzzy String Matching.

    • esmre – Regular expression accelerator.

    • shortuuid – A generator library for concise, unambiguous and URL-safe UUIDs.

    • awesome-slugify – A Python slugify library that can preserve unicode.

    • python-slugify – A Python slugify library that translates unicode to ASCII.

    • unicode-slugify – A slugifier that generates unicode slugs with Django as a dependency.

    • unidecode – ASCII transliterations of Unicode text.

    • chardet – Python 2/3 compatible character encoding detector.

    • xpinyin – A library to translate Chinese hanzi (漢字) to pinyin (拼音).

    • pangu.py – Spacing texts for CJK and alphanumerics.

    • pyfiglet – An implementation of figlet written in Python.

  • Specific Formats

    • tablib – A module for Tabular Datasets in XLS, CSV, JSON, YAML.

    • python-docx – Reads, queries and modifies Microsoft Word 2007/2008 docx files.

    • xlwt / xlrd – Packages is for writing and reading data and formatting information from Excel files.

    • XlsxWriter – A Python module for creating Excel .xlsx files.

    • mm – Python powered spreadsheets.

    • PDFMiner – A tool for extracting information from PDF documents.

    • PyPDF2 – A pure Python PDF library capable of splitting, merging and transforming PDF pages.

    • Python-Markdown – A Python implementation of John Gruber’s Markdown.

    • Mistune – Fastest and full featured pure Python parsers of Markdown.

    • PyYAML – YAML implementations for Python.

  • Parser

    • phonenumbers – Library for parsing, formatting, storing and validating international phone numbers.

    • python-user-agents – Browser user agent parser.

    • sqlparse – A non-validating SQL parser.

    • Pygments – A generic syntax highlighter.

    • python-nameparser – A simple Python module for parsing human names into their individual components.

    • pyparsing – A general purpose framework for generating parsers.

Natural Language Processing

Libraries for working with human languages.

  • NLTK – A leading platform for building Python programs to work with human language data.

  • Pattern – A web mining module for the Python programming language. It has tools for natural language processing, machine learning, among others.

  • TextBlob – Providing a consistent API for diving into common natural language processing (NLP) tasks. Stands on the giant shoulders of NLTK and Pattern, and plays nicely with both.

  • jieba – Chinese Words Segementation Utilities.

  • SnowNLP – A library for processing Chinese text.

  • loso – Another Chinese segmentation library.

  • genius – A Chinese segment base on Conditional Random Field.

Documentation

Libraries for generating project documentation.

  • Sphinx – Python Documentation generator.

  • reStructuredText – Markup Syntax and Parser Component of Docutils.

  • MkDocs – Markdown friendly documentation generator.

  • Pycco – The original quick-and-dirty, hundred-line-long, literate-programming-style documentation generator.

Configuration

Libraries for storing configuration options.

  • ConfigParser – (Python standard library) INI file parser.

  • ConfigObj – INI file parser with validation.

  • config – Hierarchical config from the author of logging.

  • profig – Config from multiple formats with value conversion.

Command-line Tools

Libraries for building command-line application.

  • Command-line Application Development

    • cement – Cement provides a light-weight and fully featured foundation to build anything from single file scripts to complex and intricately designed applications.

    • click – A package for creating beautiful command line interfaces in a composable way.

    • clint – Python Command-line Application Tools.

    • cliff – A framework for creating command-line programs with multi-level commands.

    • Clime – Clime lets you convert any module into a multi-command CLI program without any configuration.

    • docopt – Pythonic command line arguments parser.

    • colorama – Cross-platform colored terminal text.

  • Productivity Tools

    • cookiecutter – A command-line utility that creates projects from cookiecutters (project templates). E.g. Python package projects, jQuery plugin projects.

    • httpie – A command line HTTP client, a user-friendly cURL replacement.

    • percol – Adds flavor of interactive selection to the traditional pipe concept on UNIX.

    • RainbowStream – Smart and nice Twitter client on terminal.

Downloader

Libraries for downloading.

  • s3cmd – A command line tool for managing Amazon S3 and CloudFront.

  • youtube-dl – A small command-line program to download videos from YouTube.

  • you-get – A YouTube/Youku/Niconico video downloader written in Python 3.

  • coursera – Script for downloading Coursera.org videos and naming them.

  • WikiTeam – Tools for downloading and preserving wikis.

  • subliminal – Library and command line tool to search and download subtitles.

Imagery

Libraries for manipulating images.

  • pillow – Pillow is the friendly PIL fork. PIL is the Python Imaging Library.

  • wand – Python bindings for MagickWand, C API for ImageMagick.

  • thumbor – A smart imaging service. It enables on-demand crop, resizing and flipping of images.

  • imgSeek – A project for searching a collection of images using visual similarity.

  • python-qrcode – A pure Python QR Code generator.

  • pyBarcode – Create barcodes in Python without needing PIL.

  • pygram – Instagram-like image filters.

  • Quads – Computer art based on quadtrees.

  • nude.py – Nudity detection.

  • scikit-image – A Python library for (scientific) image processing.

  • hmap – Image histogram remapping.

Audio

Libraries for manipulating audio.

  • audiolazy – Expressive Digital Signal Processing (DSP) package for Python.

  • audioread – Cross-library (GStreamer + Core Audio + MAD + FFmpeg) audio decoding.

  • beets – A music library manager and MusicBrainz tagger.

  • dejavu – Audio fingerprinting and recognition.

  • django-elastic-transcoder – Django + Amazon Elastic Transcoder.

  • eyeD3 – A tool for working with audio files, specifically MP3 files containing ID3 metadata.

  • id3reader – A Python module for reading MP3 meta data.

  • mutagen – A Python module to handle audio metadata.

  • pydub – Manipulate audio with a simple and easy high level interface.

  • pyechonest – Python client for the Echo Nest API.

  • talkbox – A Python library for speech/signal processing.

  • TimeSide – Open web audio processing framework.

  • tinytag – A library for reading music meta data of MP3, OGG, FLAC and Wave files.

Video

Libraries for manipulating video and GIFs.

  • moviepy – A module for script-based movie editing with many formats, including animated GIFs.

  • shorten.tv – Video summarization.

  • scikit-video – Video processing routines for SciPy.

Geolocation

Libraries for geocoding addresses and working with latitudes and longitudes.

  • GeoDjango – A world-class geographic web framework.

  • geopy – Python Geocoding Toolbox.

  • pygeoip – Pure Python GeoIP API.

  • GeoIP – Python API for MaxMind GeoIP Legacy Database.

  • geojson – Python bindings and utlities for GeoJSON.

  • django-countries – A Django app that provides country choices for use with forms, flag icons static files, and a country field for models.

HTTP

Libraries for working with HTTP.

  • requests – HTTP Requests for Humans™.

  • urllib3 – HTTP library with thread-safe connection pooling, file post support, sanity friendly, and more.

  • httplib2 – Comprehensive HTTP client library.

  • treq – Python requests like API built on top of Twisted’s HTTP client.

Database

Databases implemented in Python.

  • ZODB – A native object database for Python. A key-value and object graph database.

Database Drivers

Libraries for connecting and operating databases.

  • Relational Databases

    • mysql-python – The MySQL database connector for Python.

    • mysqlclient – mysql-python fork supporting Python 3.

    • PyMySQL – Pure Python MySQL driver compatible to mysql-python.

    • mysql-connector-python – A pure Python MySQL driver from Oracle.

    • oursql – A better MySQL connector for Python with support for native prepared statements and BLOBs.

    • psycopg2 – The most popular PostgreSQL adapter for Python.

    • txpostgres – Twisted based asynchronous driver for PostgreSQL.

  • NoSQL Databases

    • cassandra-python-driver – Python driver for Cassandra by Datastax.

    • pycassa – Python Thrift driver for Cassandra.

    • PyMongo – The official Python client for MongoDB.

    • redis-py – The Redis Python Client.

    • py2neo – Python wrapper client for Neo4j’s restful interface.

    • telephus – Twisted based client for Cassandra.

    • txRedis – Twisted based client for Redis.

ORM

Libraries that implement Object-Relational Mapping or datamapping techniques.

  • Relational Databases

    • Django Models – A part of Django.

    • SQLAlchemy – The Python SQL Toolkit and Object Relational Mapper.

    • peewee – A small, expressive ORM.

    • PonyORM – ORM that provides a generator-oriented interface to SQL.

  • NoSQL Databases

    • MongoEngine – A Python Object-Document-Mapper for working with MongoDB.

    • django-mongodb-engine – Django MongoDB Backend.

    • redisco – A Python Library for Simple Models and Containers Persisted in Redis.

Web Frameworks

Full stack web frameworks.

  • Django – The most popular web framework in Python.

  • Flask – A microframework for Python.

  • Bottle – A fast, simple and lightweight WSGI micro web-framework.

  • Pyramid – A small, fast, down-to-earth, open source Python web framework.

  • web2py – A full stack web framework and platform focused in the ease of use.

  • web.py – A web framework for Python that is as simple as it is powerful.

  • TurboGears – The Web Framework that scales with you. Starts as a microframework and scales up to a fullstack solution.

  • CherryPy – A Minimalist Python Web Framework, HTTP/1.1-compliant and WSGI thread-pooled.

  • Grok – A framework built on the existing Zope 3 libraries, offers a lot of building blocks for web development.

  • Bluebream – An open-source web application server, framework and library, created by the Zope community and formerly known as Zope 3.

  • guava – A lightweight and high performance web framework for Python written in C.

Permissions

Libraries that allow or deny users access to data or functionality.

  • django-guardian – Implementation of per object permissions for Django 1.2+

  • Carteblanche – Module to align code with thoughts of users and designers. Also magically handles navigation and permissions.

CMS

Content Management Systems.

  • django-cms – An Open source enterprise content management system based on the Django framework.

  • djedi-cms – A lightweight but yet powerful Django content management system with plugins, inline editing and performance in mind.

  • FeinCMS – One of the most advanced Content Management Systems built on Django.

  • Kotte – A high-level, Pythonic web application framework built on Pyramid.

  • Mezzanine – A powerful, consistent, and flexible content management platform.

  • Opps – A Django-based CMS for magazines, newspapers websites and portals with high-traffic.

  • Plone – Content Management System built on top of the open source application server Zope and the accompanying Content Management Framework.

  • Quokka – Flexible, extensible, small CMS powered by Flask and MongoDB.

  • Wagtail – A Django content management system.

  • Widgy – Last CMS framework, based on Django.

E-commerce

Frameworks and libraries for e-commerce.

  • django-oscar – An open-source e-commerce framework for Django.

  • django-shop – A Django based shop system.

  • merchant – A Django app to accept payments from various payment processors via Pluggable backends.

RESTful API

Libraries for developing RESTful APIs.

  • cornice – A REST framework for Pyramid.

  • django-rest-framework – A powerful and flexible toolkit that makes it easy to build Web APIs.

  • django-tastypie – Creating delicious APIs for Django apps.

  • django-formapi – Create JSON APIs with HMAC authentication and Django form-validation.

  • flask-api – An implementation of the same web browsable APIs that django-rest-framework provides.

  • flask-restful – An extension for Flask that adds support for quickly building REST APIs.

  • flask-api-utils – Flask extension that takes care of API representation and authentication.

  • falcon – A high-performance Python framework for building cloud APIs and web app backends.

  • eve – REST API framework powered by Flask, MongoDB and good intentions.

  • sandman – Automated REST APIs for existing database-driven systems.

  • restless – Framework agnostic REST framework based on lessons learned from TastyPie.

Authentication and OAuth

Libraries for implementing authentications schemes.

  • Authomatic – Simple but powerful framework agnostic authentication/authorization client package.

  • OAuthLib – A generic, spec-compliant, thorough implementation of the OAuth request-signing logic.

  • rauth – A Python library for OAuth 1.0/a, 2.0, and Ofly.

  • python-oauth2 – A fully tested, abstract interface to creating OAuth clients and servers.

  • python-social-auth – An easy-to-setup social authentication mechanism.

  • django-oauth-toolkit – OAuth2 goodies for the Djangonauts.

  • django-oauth2-provider – Providing OAuth2 access to Django app.

  • django-allauth – Authentication app for Django that “just works.”

  • Flask-OAuthlib – OAuth 1.0/a, 2.0 implementation of client and provider for Flask.

  • sanction – A dead simple OAuth2 client implementation.

  • jose – JavaScript Object Signing and Encryption (JOSE) draft implementation, useful for stateful tokens.

Template Engine

Libraries and tools for templating and lexing.

  • Jinja2 – A modern and designer friendly templating language.

  • Genshi – Python templating toolkit for generation of web-aware output.

  • Mako – Hyperfast and lightweight templating for the Python platform.

  • Chameleon – Chameleon is an HTML/XML template engine for Python. Modeled after ZPT, optimized for speed.

  • Spitfire – A very fast Python template compiler.

Queue

Libraries for working with event and task queues.

  • celery – An asynchronous task queue/job queue based on distributed message passing.

  • huey – Little multi-threaded task queue.

  • mrq – Mr. Queue – A distributed worker task queue in Python using Redis & gevent.

  • rq – Simple job queues for Python.

  • simpleq – A simple, infinitely scalable, Amazon SQS based queue.

Search

Libraries and software for indexing and performing search queries on data.

News Feed

Libraries for building user’s activities.

  • Feedly – A library which allows you to build newsfeed and notification systems using Cassandra and/or Redis.

  • django-activity-stream – Generate generic activity streams from the actions on your site.

Asset Management

Tools for managing, compressing and minifying website assets.

  • django-compressor – Compresses linked and inline javascript or CSS into a single cached file.

  • jinja-assets-compressor – A Jinja extension (compatible with Flask and other frameworks) to compile and/or compress your assets.

  • webassets – Bundles, optimizes, and manages unique cache-busting URLs for static resources.

  • fanstatic – Packages, optimizes, and serves static file dependencies as Python packages.

  • fileconveyor – Monitors changes, processes, and transports assets to CDNs and file storage systems.

  • django-storages – A collection of custom storage backends for Django.

  • glue – Glue is a simple command line tool to generate CSS sprites.

  • libsass-python – A Python binding of libsass, the reference implementation of SASS/SCSS.

  • Flask-Assets – Helps you integrate webassets into your Flask app.

Caching

Libraries for caching data.

  • Beaker – A library for caching and sessions for use with web applications and stand-alone Python scripts and applications.

  • dogpile.cache – dogpile.cache is next generation replacement for Beaker made by same authors.

  • HermesCache – Python caching library with tag-based invalidation and dogpile effect prevention.

  • django-cache-machine – Automatic caching and invalidation for Django models through the ORM.

  • django-cacheops – A slick ORM cache with automatic granular event-driven invalidation.

  • johnny-cache – A caching framework for django applications.

  • django-viewlet – Render template parts with extended cache control.

  • pylibmc – A Python wrapper around the libmemcached interface.

Email

Libraries for sending and parsing email.

  • inbox.py – Python SMTP Server for Humans.

  • imbox – Python IMAP for Humans.

  • inbox – The open source email toolkit.

  • lamson – Pythonic SMTP Application Server.

  • flanker – A email address and Mime parsing library.

  • marrow.mailer – High-performance extensible mail delivery framework.

  • django-celery-ses – Django email backend with AWS SES and Celery.

  • modoboa – A mail hosting and management platform including a modern and simplified Web User Interface.

  • envelopes – Mailing for human beings.

  • mailjet – Mailjet API implementation for batch mailing, statistics and more.

Internationalization

Libraries for woking with i18n.

  • Babel – An internationalization library for Python.

URL Manipulation

Libraries for parsing URLs.

  • furl – A small Python library that makes manipulating URLs simple.

  • purl – A simple, immutable URL class with a clean API for interrogation and manipulation.

  • pyshorteners – A pure Python URL shortening lib.

HTML Manipulation

Libraries for working with HTML and XML.

  • BeautifulSoup – Providing Pythonic idioms for iterating, searching, and modifying HTML or XML.

  • lxml – A very fast, easy-to-use and versatile library for handling HTML and XML.

  • html5lib – A standards-compliant library for parsing and serializing HTML documents and fragments.

  • pyquery – A jQuery-like library for parsing HTML.

  • cssutils – A CSS library for Python.

  • MarkupSafe – Implements a XML/HTML/XHTML Markup safe string for Python.

  • bleach – A whitelist-based HTML sanitization and text linkification library.

  • xmltodict – Working with XML feel like you are working with JSON.

  • xhtml2pdf – HTML/CSS to PDF converter.

  • untangle – Converts XML documents to Python objects for easy access.

Web Crawling

Libraries for scraping websites.

  • Scrapy – A fast high-level screen scraping and web crawling framework.

  • portia – Visual scraping for Scrapy.

  • feedparser – Universal feed parser.

  • RoboBrowser – A simple, Pythonic library for browsing the web without a standalone web browser.

  • MechanicalSoup – A Python library for automating interaction with websites.

Web Content Extracting

Libraries for extracting web contents.

  • newspaper – News extraction, article extraction and content curation in Python.

  • html2text – Convert HTML to Markdown-formatted text.

  • python-goose – HTML Content/Article Extractor.

  • lassie – Web Content Retrieval for Humans.

  • micawber – A small library for extracting rich content from URLs.

  • sumy – A module for automatic summarization of text documents and HTML pages.

  • Haul – An Extensible Image Crawler.

  • python-readability – Fast Python port of arc90’s readability tool.

  • opengraph – A Python module to parse the Open Graph Protocol

Forms

Libraries for working with forms.

  • WTForms – A flexible forms validation and rendering library.

  • WTForms-JSON – A WTForms extension for JSON data handling.

  • Deform – Python HTML form generation library influenced by the formish form generation library.

  • django-bootstrap3 – Bootstrap 3 integration with Django.

  • django-crispy-forms – A Django app which lets you create beautiful forms in a very elegant and DRY way.

  • django-remote-forms – A platform independent Django form serializer.

Data Validation

Libraries for validating data. Used for forms in many cases.

  • voluptuous – A Python data validation library. It is primarily intended for validating data coming into Python as JSON, YAML, etc.

  • colander – A system for validating and deserializing data obtained via XML, JSON, an HTML form post or any other equally simple data serialization.

  • schema – A library for validating Python data structures.

  • Schematics – Data Structure Validation.

  • kmatch – A language for matching/validating/filtering Python dictionaries.

  • valideer – Lightweight extensible data validation and adaptation library.

Anti-spam

Libraries for fighting spam.

Tagging

Libraries for tagging items.

Admin Panels

Libraries for administrative interfaces.

  • Ajenti – The admin panel your servers deserve.

  • Grappelli – A jazzy skin for the Django Admin-Interface.

  • django-suit – Alternative Django Admin-Interface (free only for Non-commercial use).

  • django-xadmin – Drop-in replacement of Django admin comes with lots of goodies.

  • flask-admin – Simple and extensible administrative interface framework for Flask.

  • flower – Real-time monitor and web admin for Celery.

Static Site Generator

Static site generator is a software that takes some text + templates as input and produces html files on the output.

  • Pelican – Uses Markdown or ReST for content and Jinja 2 for themes. Supports DVCS, Disqus. AGPL.

  • Cactus – Static site generator for designers.

  • Hyde – Jinja2-based static web site generator.

  • Nikola – A static website and blog generator.

  • Tags – The simplest static site generator.

  • Tinkerer – Tinkerer is a blogging engine/.static website generator powered by Sphinx.

Processes and Threads

Libraries for woking with processes or threads

  • multiprocessing – (Python standard library) Process-based “threading” interface.

  • threading – (Python standard library) Higher-level threading interface.

  • envoy – Python Subprocesses for Humans™.

  • sh – A full-fledged subprocess replacement for Python.

  • sarge – A wrapper for subprocess.

Concurrency and Networking

Libraries for concurrency and network programming.

  • asyncio – (Python standard library in Python 3.4+) Asynchronous I/O, event loop, coroutines and tasks.

  • gevent – A coroutine-based Python networking library that uses greenlet.

  • Twisted – An event-driven networking engine.

  • Tornado – A Web framework and asynchronous networking library.

  • pulsar – Event-driven concurrent framework for Python.

  • diesel – Greenlet-based event I/O Framework for Python.

  • eventlet – Asynchronous framework with WSGI support.

  • pyzmq – A Python wrapper for the 0MQ message library.

  • txZMQ – Twisted based wrapper for the 0MQ message library.

  • Crossbar – Open-source Unified Application Router (Websocket & WAMP for Python on Autobahn).

WebSocket

Libraries for woking with WebSocket.

WSGI Servers

WSGI-compatible web servers.

  • wsgiref – (Python standard library) WSGI reference implementation, single-threaded.

  • Werkzeug – A WSGI utility library for Python that powers Flask and can easily be embedded into your own projects.

  • paste – Multi-threaded, stable, tried and tested.

  • rocket – Multi-threaded.

  • waitress – Multi-threaded, poweres Pyramid.

  • netius – Asynchronous, very fast.

  • gunicorn – Pre-forked, partly written in C.

  • fapws3 – Asynchronous (network side only), written in C.

  • meinheld – Asynchronous, partly written in C.

  • bjoern – Asynchronous, very fast and written in C.

RPC Servers

RPC-compatible servers.

Cryptography

  • PyCrypto – The Python Cryptography Toolkit.

  • Paramiko – A Python (2.6+, 3.3+) implementation of the SSHv2 protocol, providing both client and server functionality.

  • cryptography – A package designed to expose cryptographic primitives and recipes to Python developers.

  • hashids – Implementation of hashids in Python.

GUI

Libraries for working with graphical user interface applications.

  • PyQt – Python bindings for the Qt cross-platform application and UI framework, with support for both Qt v4 and Qt v5 frameworks.

  • PySide – Python bindings for the Qt cross-platform application and UI framework, supporting the Qt v4 framework.

  • wxPython – A blending of the wxWidgets C++ class library with the Python.

  • kivy – A library for creating NUI applications, running on Windows, Linux, Mac OS X, Android and iOS.

  • curses – Built-in wrapper for ncurses used to create terminal GUI applications.

  • urwid – A library for creating terminal GUI applications with strong support for widgets, events, rich colors, etc.

  • pyglet – A cross-platform windowing and multimedia library for Python.

  • Tkinter – Tkinter is Python’s de-facto standard GUI package.

  • enaml – Create beautiful user-interfaces with Declaratic Syntax like QML

Game Development

Awesome game development libraries.

  • Pygame – Pygame is a set of Python modules designed for writing games.

  • Cocos2d – cocos2d is a framework for building 2D games, demos, and other graphical/interactive applications. It is based on pyglet.

  • PySDL2 – A ctypes based wrapper for the SDL2 library.

  • Panda3D – 3D game engine developed by Disney and maintained by Carnegie Mellon’s Entertainment Technology Center. Written in C++, completely wrapped in Python.

  • PyOgre – Python bindings for the Ogre 3D render engine, can be used for games, simulations, anything 3D.

  • PyOpenGL – Python ctypes bindings for OpenGL and it’s related APIs.

  • PySFML – Python bindings for SFML

  • RenPy – A Visual Novel engine.

Logging

Libraries for generating and working with log files.

  • logging – (Python standard library) Logging facility for Python.

  • logbook – Logging replacement for Python.

  • Sentry – A realtime logging and aggregation server.

  • Raven – The Python client for Sentry.

Testing

Libraries for testing codebases and generating test data.

  • Testing Frameworks

    • unittest – (Python standard library) Unit testing framework.

    • nose – nose extends unittest.

    • pytest – A mature full-featured Python testing tool.

    • mamba – The definitive testing tool for Python. Born under the banner of BDD.

    • contexts – A modern and flexible BDD framework for Python 3.3 and above, inspired by C#’sMachine.Specifications.

    • pyshould – Should style asserts based on PyHamcrest.

  • Mock

    • mock – A Python Mocking and Patching Library for Testing.

    • responses – A utility library for mocking out the requests Python library.

    • doublex – Powerful test doubles framework for Python.

    • freezegun – Travel through time by mocking the datetime module.

    • httpretty – HTTP request mock tool for Python.

  • Fake Data

    • faker – A Python package that generates fake data.

    • mixer – Generating fake data and creating random fixtures for testing in Django ORM, SQLAlchemy, Peewee, MongoEngine, Pony ORM and etc.

    • model_mommy – Creating random fixtures for testing in Django.

  • Code Coverage

    • coverage – Code coverage measurement.

  • Load Testing

    • locust – Scalable user load testing tool written in Python.

  • Error Handler

    • FuckIt.py – FuckIt.py uses state-of-the-art technology to make sure your Python code runs whether it has any right to or not.

Code Analysis and Linter

Libraries and tools for analysing, parsing and manipulation codebases.

  • Code Analysis

    • pysonar2 – A type inferencer and indexer for Python.

    • pycallgraph – A library that visualises the flow (call graph) of your Python application.

    • code2flow – Turn your Python and JavaScript code into DOT flowcharts.

  • Linter

    • Flake8 – The modular source code checker: pep8, pyflakes and co.

    • pylama – Code audit tool for Python and JavaScript.

    • Pylint – A source code analyzer.

Debugging Tools

Libraries for debugging code.

  • pdb – (Python standard library) The Python Debugger.

  • ipdb – IPython-enabled pdb.

  • winpdb – A Platform Independent Python Debugger with GUI.

  • pudb – A full-screen, console-based Python debugger.

  • pyringe – Debugger capable of attaching to and injecting code into Python processes.

  • memory_profiler – Monitor Memory usage of Python code.

  • django-debug-toolbar – Display various debug information about the current request/response.

  • django-devserver – A drop-in replacement for Django’s runserver.

Science and Data Analysis

Libraries for scientific computing and data analyzing.

  • SciPy – A Python-based ecosystem of open-source software for mathematics, science, and engineering.

  • NumPy – A fundamental package for scientific computing with Python.

  • Numba – Python JIT (just in time) complier to LLVM aimed at scientific Python by the developers of Cython and NumPy.

  • NetworkX – A high-productivity software for complex networks.

  • Pandas – A library providing high-performance, easy-to-use data structures and data analysis tools.

  • Open Mining – Business Intelligence (BI) in Python (Pandas web interface)

  • PyMC – Markov Chain Monte Carlo sampling toolkit.

  • zipline – A Pythonic algorithmic trading library.

  • PyDy – Short for Python Dynamics, used to assist with workflow in the modeling of dynamic motion based around NumPy, SciPy, IPython, and matplotlib.

  • SymPy – A Python library for symbolic mathematics.

  • statsmodels – Statistical modeling and econometrics in Python.

  • astropy – A community Python library for Astronomy.

Data Visualization

Libraries for visualizing data. See: awesome-javascript’s Data Visualization section.

  • matplotlib – A Python 2D plotting library.

  • bokeh – Interactive Web Plotting for Python.

  • plotly – Collaborative web plotting for Python and matplotlib.

  • vincent – A Python to Vega translator.

  • d3py – A plottling library for Python, based on D3.js.

  • ggplot – Same API as ggplot2 for R.

  • Kartograph.py – Rendering beautiful SVG maps in Python.

  • pygal – A Python SVG Charts Creator.

Computer Vision

Libraries for computer vision.

  • OpenCV – Open Source Computer Vision Library.

  • SimpleCV – An open source framework for building computer vision applications.

Machine Learning

Libraries for Machine Learning. See: awesome-machine-learning.

  • scikit-learn – A Python module for machine learning built on top of SciPy.

  • pattern – Web mining module for Python.

  • NuPIC – Numenta Platform for Intelligent Computing.

  • Pylearn2 – A Machine Learning library based on Theano.

  • hebel – GPU-Accelerated Deep Learning Library in Python.

  • gensim – Topic Modelling for Humans.

  • PyBrain – Another Python Machine Learning Library.

  • Crab – A flexible, fast recommender engine.

  • python-recsys – A Python library for implementing a Recommender System.

MapReduce

Framworks and libraries for MapReduce.

  • PySpark – The Spark Python API.

  • dpark – Python clone of Spark, a MapReduce alike framework in Python.

  • luigi – A module that helps you build complex pipelines of batch jobs.

  • mrjob – Run MapReduce jobs on Hadoop or Amazon Web Services.

  • dumbo – Python module that allows one to easily write and run Hadoop programs.

  • streamparse – Run Python code against real-time streams of data. Integrates with Apache Storm.

Functional Programming

  • fn.py – Functional programming in Python: implementation of missing features to enjoy FP.

  • funcy – A fancy and practical functional tools.

  • Toolz – A collection of functional utilities for iterators, functions, and dictionaries.

  • CyToolz – Cython implementation of Toolz: High performance functional utilities.

Third-party APIs

Libraries for accessing third party services APIs. See: List of Python API Wrappers and Libraries.

  • apache-libcloud – One Python library for all clouds.

  • boto – Python interface to Amazon Web Services.

  • twython – A Python wrapper for the Twitter API.

  • soundcloud-python – A Python wrapper around the Soundcloud API.

  • google-api-python-client – Google APIs Client Library for Python.

  • gspread – Google Spreadsheets Python API .

  • facebook-sdk – Facebook Platform Python SDK.

  • facepy – Facepy makes it really easy to interact with Facebook’s Graph API

  • Wikipedia – A Pythonic wrapper for the Wikipedia API.

  • python-instagram – A Python Client for Instagram API.

  • gmail – A Pythonic interface for Gmail.

  • praw – A Python wrapper for the Reddit API.

  • linkedin – A Python interface for LinkedIn.

DevOps Tools

Software and libraries for DevOps.

  • OpenStack – Open source software for building private and public clouds.

  • Ansible – An IT automation tool.

  • SaltStack – Infrastructure automation and management system.

  • Fabric – Tool for streamlining the use of SSH for application deployment or systems administration tasks.

  • Fabtools – Tools for writing awesome Fabric files.

  • cuisine – Chef-like functionality for Fabric.

  • psutil – A cross-platform process and system utilities module.

  • pexpect – A Python module for controlling interactive programs in a pseudo-terminal like GNU expect.

  • provy – An easy-to-use provisioning system in Python.

Job Scheduler

Libraries for scheduling jobs.

  • APScheduler – A light but powerful in-process task scheduler that lets you schedule functions.

  • django-schedule – A calendaring app for Django.

  • doit – A task runner/build tool.

  • Joblib – A set of tools to provide lightweight pipelining in Python.

  • Plan – Writing crontab file in Python like a charm.

  • Spiff – A powerful workflow engine implemented in pure Python.

  • schedule – Python job scheduling for humans.

  • TaskFlow – A Python library that helps to make task execution easy, consistent and reliable.

Foreign Function Interface

Libraries for providing foreign function interface.

  • ctypes – (Python standard library) Foreign Function Interface for Python calling C code.

  • cffi – Foreign Function Interface for Python calling C code.

  • SWIG – Simplified Wrapper and Interface Generator.

  • PyCUDA – A Python wrapper for Nvidia’s CUDA API.

High Performance

Libraries for making Python faster.

  • Cython – Optimizing Static Complier for Python. Uses type mixins to compile Python into C or C++ modules resulting in large performance gains.

  • PyPy – An implementation of Python in Python. The interpreter uses black magic to make Python very fast without having to add in additional type information.

  • Stackless Python – An enhanced version of the Python.

  • Pyston – A Python implementation built using LLVM and modern JIT techniques with the goal of achieving good performance.

Microsoft Windows

Python programming on Microsoft Windows.

  • pythonlibs – Unofficial Windows(32/64-bit) binaries for Python extension packages

  • Python(x,y) – Scientific-applications-oriented Python Distribution based on Qt and Spyder.

  • spyder – IDE for the Python language with advanced editing, interactive testing, debugging and introspection features (also comes with Anaconda).

Network Virtualization and SDN

Tools and libraries for Virtual Networking and SDN (Software Defined Networking).

  • Mininet – A popular network emulator and API written in Python.

  • POX – An open source development platform for Python-based Software Defined Networking (SDN) control applications, such as OpenFlow SDN controllers.

  • Pyretic – A member of the Frenetic family of SDN programming languages that provides powerful abstractions over network switches or emulators.

  • SDX Platform – SDN based IXP implementation that leverages Mininet, POX and Pyretic.

Hardware

Libraries for programming with hardware.

  • wifi – A Python library and command line tool for working with WiFi on Linux.

  • scapy – A brilliant packet manipulation library.

Miscellaneous

Useful libraries or tools that don’t fit in the categories above.

  • pluginbase – A simple but flexible plugin system for Python.

  • itsdangerous – Various helpers to pass trusted data to untrusted environments.

  • blinker – A fast Python in-process signal/event dispatching system.

Algorithms and Design Patterns

Collections of algorithms and design patterns.

Editor Plugins

Plugins for editors and IDEs.

  • Vim

    • Python-mode – An all in one plugin for turning Vim into a Python IDE.

    • Jedi-vim – Vim bindings for the Jedi autocompletion library for Python.

  • Emacs

    • Elpy – Emacs Python Development Environment.

  • Sublime Text

    • SublimeJEDI – A Sublime Text plugin to the awesome autocomplete library Jedi.

    • Anaconda – Anaconda turns your Sublime Text 3 in a full featured Python development IDE.

    • Djaneiro – Django support for Sublime Text.

Resources

Where to discover new Python libraries.

Websites

Weekly

  • Pycoder’s Weekly – A free weekly newsletter, on Fridays, for those interested in Python development and various topics around Python.

  • Python Weekly – A free weekly newsletter featuring curated news, articles, new releases, jobs etc related to Python.

Twitter

Other Awesome Lists

List of lists.

来源:51CTO

相关实践学习
基于Hologres轻量实时的高性能OLAP分析
本教程基于GitHub Archive公开数据集,通过DataWorks将GitHub中的项⽬、行为等20多种事件类型数据实时采集至Hologres进行分析,同时使用DataV内置模板,快速搭建实时可视化数据大屏,从开发者、项⽬、编程语⾔等多个维度了解GitHub实时数据变化情况。
阿里云实时数仓实战 - 用户行为数仓搭建
课程简介 1)学习搭建一个数据仓库的过程,理解数据在整个数仓架构的从采集、存储、计算、输出、展示的整个业务流程。 2)整个数仓体系完全搭建在阿里云架构上,理解并学会运用各个服务组件,了解各个组件之间如何配合联动。 3 )前置知识要求:熟练掌握 SQL 语法熟悉 Linux 命令,对 Hadoop 大数据体系有一定的了解   课程大纲 第一章 了解数据仓库概念 初步了解数据仓库是干什么的 第二章 按照企业开发的标准去搭建一个数据仓库 数据仓库的需求是什么 架构 怎么选型怎么购买服务器 第三章 数据生成模块 用户形成数据的一个准备 按照企业的标准,准备了十一张用户行为表 方便使用 第四章 采集模块的搭建 购买阿里云服务器 安装 JDK 安装 Flume 第五章 用户行为数据仓库 严格按照企业的标准开发 第六章 搭建业务数仓理论基础和对表的分类同步 第七章 业务数仓的搭建  业务行为数仓效果图  
相关文章
|
2月前
|
存储 Java 数据处理
(numpy)Python做数据处理必备框架!(一):认识numpy;从概念层面开始学习ndarray数组:形状、数组转置、数值范围、矩阵...
Numpy是什么? numpy是Python中科学计算的基础包。 它是一个Python库,提供多维数组对象、各种派生对象(例如掩码数组和矩阵)以及用于对数组进行快速操作的各种方法,包括数学、逻辑、形状操作、排序、选择、I/0 、离散傅里叶变换、基本线性代数、基本统计运算、随机模拟等等。 Numpy能做什么? numpy的部分功能如下: ndarray,一个具有矢量算术运算和复杂广播能力的快速且节省空间的多维数组 用于对整组数据进行快速运算的标准数学函数(无需编写循环)。 用于读写磁盘数据的工具以及用于操作内存映射文件的工具。 线性代数、随机数生成以及傅里叶变换功能。 用于集成由C、C++
322 1
|
3月前
|
数据库连接 数据库 Python
Python上下文管理器:告别资源泄露的优雅之道
Python上下文管理器:告别资源泄露的优雅之道
151 3
|
2月前
|
Java 数据处理 索引
(Pandas)Python做数据处理必选框架之一!(二):附带案例分析;刨析DataFrame结构和其属性;学会访问具体元素;判断元素是否存在;元素求和、求标准值、方差、去重、删除、排序...
DataFrame结构 每一列都属于Series类型,不同列之间数据类型可以不一样,但同一列的值类型必须一致。 DataFrame拥有一个总的 idx记录列,该列记录了每一行的索引 在DataFrame中,若列之间的元素个数不匹配,且使用Series填充时,在DataFrame里空值会显示为NaN;当列之间元素个数不匹配,并且不使用Series填充,会报错。在指定了index 属性显示情况下,会按照index的位置进行排序,默认是 [0,1,2,3,...] 从0索引开始正序排序行。
259 0
|
2月前
|
Java 数据挖掘 数据处理
(Pandas)Python做数据处理必选框架之一!(一):介绍Pandas中的两个数据结构;刨析Series:如何访问数据;数据去重、取众数、总和、标准差、方差、平均值等;判断缺失值、获取索引...
Pandas 是一个开源的数据分析和数据处理库,它是基于 Python 编程语言的。 Pandas 提供了易于使用的数据结构和数据分析工具,特别适用于处理结构化数据,如表格型数据(类似于Excel表格)。 Pandas 是数据科学和分析领域中常用的工具之一,它使得用户能够轻松地从各种数据源中导入数据,并对数据进行高效的操作和分析。 Pandas 主要引入了两种新的数据结构:Series 和 DataFrame。
413 0
|
2月前
|
Java 数据处理 索引
(numpy)Python做数据处理必备框架!(二):ndarray切片的使用与运算;常见的ndarray函数:平方根、正余弦、自然对数、指数、幂等运算;统计函数:方差、均值、极差;比较函数...
ndarray切片 索引从0开始 索引/切片类型 描述/用法 基本索引 通过整数索引直接访问元素。 行/列切片 使用冒号:切片语法选择行或列的子集 连续切片 从起始索引到结束索引按步长切片 使用slice函数 通过slice(start,stop,strp)定义切片规则 布尔索引 通过布尔条件筛选满足条件的元素。支持逻辑运算符 &、|。
167 0
|
3月前
|
存储 人工智能 测试技术
如何使用LangChain的Python库结合DeepSeek进行多轮次对话?
本文介绍如何使用LangChain结合DeepSeek实现多轮对话,测开人员可借此自动生成测试用例,提升自动化测试效率。
474 125
如何使用LangChain的Python库结合DeepSeek进行多轮次对话?
|
3月前
|
监控 数据可视化 数据挖掘
Python Rich库使用指南:打造更美观的命令行应用
Rich库是Python的终端美化利器,支持彩色文本、智能表格、动态进度条和语法高亮,大幅提升命令行应用的可视化效果与用户体验。
230 0
|
2月前
|
数据可视化 关系型数据库 MySQL
【可视化大屏】全流程讲解用python的pyecharts库实现拖拽可视化大屏的背后原理,简单粗暴!
本文详解基于Python的电影TOP250数据可视化大屏开发全流程,涵盖爬虫、数据存储、分析及可视化。使用requests+BeautifulSoup爬取数据,pandas存入MySQL,pyecharts实现柱状图、饼图、词云图、散点图等多种图表,并通过Page组件拖拽布局组合成大屏,支持多种主题切换,附完整源码与视频讲解。
244 4
【可视化大屏】全流程讲解用python的pyecharts库实现拖拽可视化大屏的背后原理,简单粗暴!
|
2月前
|
传感器 运维 前端开发
Python离群值检测实战:使用distfit库实现基于分布拟合的异常检测
本文解析异常(anomaly)与新颖性(novelty)检测的本质差异,结合distfit库演示基于概率密度拟合的单变量无监督异常检测方法,涵盖全局、上下文与集体离群值识别,助力构建高可解释性模型。
313 10
Python离群值检测实战:使用distfit库实现基于分布拟合的异常检测
|
3月前
|
安全 数据库连接 Python
Python中的上下文管理器:优雅地管理资源
Python中的上下文管理器:优雅地管理资源
71 6

推荐镜像

更多