Data Storage in Python - An Overview of Options
There are many possibilities in Python to store data. This tutorial explores some of them: flat file, Excel files, NetCDF and HDF5, serialization with pickle and friends, relational databases, bsddb and ZODB. The objective of this course is to give participants an overview of the available options as well as the advantages and disadvantages for different purposes. Participants are strongly recommended to bring laptops because all topics are introduced with examples and exercises.
Venue / Time
Seminar Room 2.5 (Near to Ngee Ann Kongsi Auditorium)
9.00 am - 1.00 pm (Break 10.45 - 11.15)
Intended Audience
Python programmers with intermediate knowledge.
Requirements
All participants should bring laptops with Linux, Windows, or Mac OS. Python 2.6, 2.5 or Python 2.4 need to be installed as well as an editor or IDE.
The following third-party packages are needed:
Each topic is introduced through a short lecture. There are numerous exercises for nearly all points of the outline. All source codes are provided on CD before the course. Questions are encouraged throughout the course. There is a comprehensive handout detailing all presented topics including in-depth discussions of all code examples.
Class Outline
- Handling flat files
- Excel Files
- xlrd
- xlwt
- NetCDF Files
- pynetcdf
- HDF Files
- pyTables
- Basics
- Advanced features
- Serialization
- Marshal
- Pickle and cPickle
- Shelve
- Relational Databases - DB API 2 - SQLAlchemy - SQLObject
- bsddb
- ZODB
Trainer – Mr Mike Müller
Mike Müller lives in Leipzig, Germany and works as a consultant, programmer and trainer. He programs scientific software in Python and other languages. He teaches Python since 2004 and since 2006 at the Python Academy. His courses cover introductions to Python as well as special topics such as extensions or thread programming. Being an engineer who also works in research projects, he uses numerous scientific Python packages on a daily basis and, therefore, also offers a course Python for Scientist and Engineers. When he does not program or teach, he spends time with his wife and his two kids or works out with weights and swims.
Presenter's Previous Experience
Mike gave two tutorials at PyCon 2007 (PyCon 2007_I, PyCon 2007_II), two at PyCon 2008 (PyCon 2008_I, PyCon 2008_II) as well as two tutorials at PyCon 2009 (PyCon 2009_I, PyCon 2009_II).
