Python Env Issues and Workaroud Ubuntu 16 LTS 

 
 https://www.digitalocean.com/community/tutorials/how-to-install-and-use-tensorflow-on-ubuntu-16-04
 https://www.digitalocean.com/community/tutorials/how-to-install-python-3-and-set-up-a-local-programming-environment-on-ubuntu-16-04
 https://www.digitalocean.com/community/tutorials/how-to-install-python-3-and-set-up-a-local-programming-environment-on-ubuntu-16-04
1.Installing Python
Ubuntu 16 comes with Python 2.7 and 3.5 both.
To install pip3...
 
 sudo apt-get install python3-pip


 pip3 -V


 pip3 install --upgrade pip
 
2.Virtual Env
 
 a)sudo -H pip3 install virtualenv
 b) virtualenv -p /usr/bin/python3 menv35 
 c) source ~/venv35/bin/activate 
 d) python -m pip install --upgrade pip
 


Ub untu18   https://linoxide.com/linux-how-to/setup-python-virtual-environment-ubuntu/




2# Centos python 






python -m pip install --upgrade pip


 


3. Anaconda Issues.........


 


 


anaconda sucks...when one installs packages not included with it..


 


as dependencies fail and give unstatisfied error. 


 


 


./configure --prefix=/somewhere/else/than/usr/local


 


 


 

If you get the following error message

zipimport.ZipImportError: can't decompress data; zlib not available
install the ‘zlib1g-dev’ package



apt-get install zlib1g-dev



 ./configure --prefix=/home/adarsh/work/python36 --with-zlib



sudo make

sudo make install





=====================



While installing pkgs if under proxy..u face errors like



Retrying (Retry(total=0, connect=None, read=None, redirect=None)) after connection broken by 'NewConnectionError('<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7fcf0da195f8>: Failed to establish a new connection: [Errno 101] Network is unreachable',)': /simple/matplotlib/



use

python3 -mpip install -U matplotlib --proxy="http://usid:pwd@proxy.domain.com:8080"






































Comments











Post a Comment



















Popular posts from this blog









ScoreCard Model using R





















  Example R Notebook for ScoreCard Model      One often receives mailers on pre-approved loan based on creditworthiness. When one applies for credit, often it’s approved, sometimes it isn’t...   Have you ever wondered how exactly the decision to approve a loan is done?    Was the bank able to clearly articulate the rationale of their decision to decline?   To ensure fairness and transparency, there are compliance rules which mandates Banks to have such a mechanism. The Federal Trade Commission (FTC), the nation’s(US) consumer protection agency, enforces the Equal Credit Opportunity Act (ECOA), which prohibits credit discrimination on the basis of race, color, religion, national origin, sex, marital status,age, or because you get public assistance.   In BFS, often underwriter needs to decide the creditworthiness of an applicant. Among other things, a scorecard is typically in place and long been used. Now with data deluge and better processing power many Analytical models are also used.








Read more










The auxService:mapreduce_shuffle does not exist





















  Error and Probable Fix:   1. Error : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist   Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1  2015-05-02 13:57:39,982 Stage-1 map = 0%,  reduce = 0%  2015-05-02 13:57:49,511 Stage-1 map = 100%,  reduce = 100%  Ended Job = job_1430542224940_0001 with errors  Error during job, obtaining debugging information...  Examining task ID: task_1430542224940_0001_m_000000 (and more) from job job_1430542224940_0001   Task with the most failures(4):  -----  Task ID:    task_1430542224940_0001_m_000000   URL:    http://0.0.0.0:8088/taskdetails.jsp?jobid=job_1430542224940_0001&tipid=task_1430542224940_0001_m_000000  -----  Diagnostic Messages for this Task:  Container launch failed for container_1430542224940_0001_01_000005 : org.apache.hadoop.yarn.exceptions.InvalidAuxServiceException: The auxService:mapreduce_shuffle does not exist   at sun.reflect.NativeCons








Read more










Zeppelin and Anaconda





















 Set Anaconda As Default Python Interpreter In Zeppelin   Click  anonymous  in top right corner.  Click  Interpreter .  Scroll down to the  python  interpreter.  Click  Edit .  Locate  zeppelin.python .  Set value to  /home/hadoop/anaconda/bin/python  Now find the  spark  interpreter.  Locate  zeppelin.pyspark.python .  Set value to  /home/hadoop/anaconda/bin/python    https://dziganto.github.io/zeppelin/spark/zeppelinhub/emr/anaconda/tensorflow/shiro/s3/theano/bootstrap%20script/EMR-From-Scratch/     This works..tested..      conda install -c calex sklearn-pandas    P.S:    zeppelin 0.7.3 don't support spark 2.3. spark 2.3 is supported by zeppelin 0.8 which will be released soon   zeppelin 0.7.3 doesn't support python 3.6..   now testing with spark 2.1 and python 3.5...so far so good..   Check::::::   zeppelin home/conf should have zeppelin-env.sh. Here you can specify spark home and zeppelin port      Starting Apache Zeppelin from the Command Line   On all unix like platforms








Read more