top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

Is there a way to install ALL Python packages?

+1 vote
642 views

I'd like to install ALL Python packages on my machine. Even if it takes up 4-5GB, or more, I'd like to get everything, and then use it when I need it. Now, I'd like to import packages, like numpy and pandas, but nothing will install. I figure, if I can just install everything, I can simply use it when I need it, and if I don't need it, then I just won't use it.

I know R offers this as an option. I figure Python must allow it too.

Any idea how to grab everything?

posted Jul 21, 2015 by Deepak Dasgupta

Share this question
Facebook Share Button Twitter Share Button LinkedIn Share Button

3 Answers

+1 vote

Since I'm sure there are conflicts between some packages as well as completely broken packages, I suspect this isn't really possible or desirable.

And it won't solve your problem. If you can't get numpy and pandas to install, you may have troubles with "everything" also.

Are you sure you followed the instructions on the page you linked to in your pandas install thread? Seems like you typed "python get-pip.py" in a python prompt instead of your operating system command prompt. I recall telling you about this before. You download the get-pip.py file, put it somewhere, like on your desktop, then open the command prompt window, cd to that directory, and then run "python get-pip.py" from your cmd.exe C: prompt.

answer Jul 21, 2015 by Luv Kumar
+1 vote

I'd like to install ALL Python packages on my machine.

There is no official list of Python packages to upload all of.

Even if it takes up 4-5GB, or more, I'd like to get everything,

There are 10000 packages on Pypi, and perhaps an equal number elsewhere.

and then use it when I need it.

Many are just names or junk that you would never use and do not want on your machine. Many are specialized add-ons to another package. It seems that Python is different from R.
pip can load a list of packages. This is used daily to build machines with Python + a specified list. It would be an interesting project for someone to make, publish, and update a 'sumo' list of the most useful packages that can all be loaded together.

answer Jul 21, 2015 by Deepankar Dubey
0 votes

pip install wget https://pypi.python.org/simple/ -qO- |html2text

Then figure out if there are any conflicts.

And make sure you stay up-to-date as packages get new versions released.

answer Jul 21, 2015 by Majula Joshi
Similar Questions
+3 votes

What would be the best way to install mock on my Centos server? yum install mock does not recognize the
package. Have already installed 'Developer tools' using yum groupinstall.

0 votes

I'm trying to write a function that programmatically obtains and returns the exact location of all first-level modules for all installed packages.

For example, if the packages named 'django' and 'django-debug-toolbar' are installed, I'd like this function to return something like:

installed_modules()
/Users/my_user/.virtualenvs/my_venv/lib/python2.6/site-packages/django
/Users/my_user/.virtualenvs/my_venv/src/debug_toolbar

That is, this function needs to consider all installed packages, including those that have been installed in "edit" mode (i.e. in the src/ folder). Note also that the main module for the 'django-debug-toolbar' is in fact named 'debug_toolbar'.

So far the closest I've been to retrieving the list of first-level modules is as follows:

 import os
 import pkg_resources
 import setuptools

 pkgs = set()

 for dist in pkg_resources.working_set:
 if os.path.isdir(dist.location):
 for pkg in setuptools.find_packages(dist.location):
 if '.' not in pkg:
 pkgs.add(pkg)

The idea is then to loop through that list of modules, import them and get their exact locations by fetching their __file__ attribute values.

However, this feels very hackish and I don't think it's actually quite correct either. I'm sure there must be a better way. If possible I'd also like to avoid having to use setuptools.

Does anyone have any tips on how to achieve this?

+2 votes

Also is there a way to detect if the user presses a key in Python that works on most OS's? I've only seen 1 method and that only works in Python 2.6 and less. If you get the key, can you store it in a variable?

+2 votes

Is there a way to use pdb to debug Google apps written in Python? When I start the development system to run the app "test" like this -

'./google_appengine/dev_appserver.py ./test'

  • I'd like to send the program into debug. I couldn't see anything in the documentation how to do this. If I do this - python -mpdb './google_appengine/dev_appserver.py' './test'
  • then dev_appserver.py goes into debug but doesn't know anything about "test".
0 votes

I have an Ubuntu VDI image (created through Virtual box) in one laptop and want to install Ubuntu on bare metal using this VDI image.
Is it possible ?

...