User:Mstone/Tricks: Difference between revisions

From OLPC
Jump to navigation Jump to search
mNo edit summary
mNo edit summary
 
(19 intermediate revisions by the same user not shown)
Line 1: Line 1:
This page contains pointers to a collection of idioms which I rely on to accomplish tasks quickly and with predictable results.
==== Verbose Python Tracebacks ====


; verbose python tracebacks
Just import [http://teach.laptop.org/~mstone/nice_traces.py nice_traces]; if you're feeling fancy, then consider <tt>trace(sys.exc_info())</tt>
: <tt>import [http://docs.python.org/library/cgitb.html cgitb]; cgitb.enable(format="plain")</tt>


; verbosity controls on logging
==== Handy report() function ====
: See [http://dev.laptop.org/git?p=projects/mocktools;a=blob;f=trac_helper.py;hb=HEAD trac_helper.py]


; pythonic relations
See [http://dev.laptop.org/git?p=projects/mocktools;a=blob;f=trac_helper.py;hb=HEAD trac_helper.py]
: See my [http://dev.laptop.org/git/users/mstone/relation relation] module and [http://alloy.mit.edu Alloy] (which was my inspiration, though I've made nothing more than a poor knockoff).


; relational error logging
==== Pythonic relations ====
: See [http://dev.laptop.org/git?p=projects/mocktools;a=blob;f=trac_helper.py;hb=HEAD trac_helper.py] and [http://dev.laptop.org/git?p=projects/buildtools;a=blob;f=collect-pkgs.py;hb=HEAD collect-pkgs.py].


; email-based error reporting
See my [http://dev.laptop.org/git/users/mstone/relation relation] module and [http://alloy.mit.edu Alloy] (which was my inspiration, though I've made nothing more than a poor knockoff).
: See [http://dev.laptop.org/git?p=projects/buildtools;a=blob;f=email_warnings.py;hb=HEAD email_warnings.py].


; pdb
==== Relational error logging ====
: <tt>from pdb import set_trace as debug ... debug()</tt>


; rpm makefiles
See [http://dev.laptop.org/git?p=projects/mocktools;a=blob;f=trac_helper.py;hb=HEAD trac_helper.py] and [http://dev.laptop.org/git?p=projects/buildtools;a=blob;f=collect-pkgs.py;hb=HEAD collect-pkgs.py].
: See [http://dev.laptop.org/git?p=users/mstone/rpm-packaging;a=tree rpm-packaging] as well as individual projects like [http://dev.laptop.org/git/projects/olpc-netutils olpc-netutils] along with my [[Developer/Fedora#Outside Reading|Fedora packaging bibliography]].


; pymeta parser-based controllers
==== Email-based error reporting ====
: [http://dev.laptop.org/git?p=users/mstone/triagebot;a=blob;f=grammar.py;hb=grammar triagebot] is based on a model-view-controller architecture where the controller object is assembled at runtime based on data collected with a metaclass.
: [https://launchpad.net/pymeta pymeta] makes it easy to pick the right response to complicated input.


; python gdb macros
See [http://dev.laptop.org/git?p=projects/buildtools;a=blob;f=email_warnings.py;hb=HEAD email_warnings.py].
: http://wiki.python.org/moin/DebuggingWithGdb


; python memory profiling
==== RPM Makefiles ====
: [http://dev.laptop.org/git/users/mstone/guppy guppy] + Tomeu's [[memory leak testing]] writeup.


; tree-based python context management
See [http://dev.laptop.org/git?p=users/mstone/rpm-packaging;a=tree rpm-packaging] as well as individual projects like [http://dev.laptop.org/git/projects/olpc-netutils] along with my [[Developer/Fedora#Outside Reading|Fedora packaging bibliography]].
: [http://dev.laptop.org/git?p=users/mstone/puritan;a=blob;f=main.py;hb=f9#l16 puritan's main.py] and [http://dev.laptop.org/git?p=users/mstone/puritan;a=blob;f=contexts.py;hb=f9 contexts.py]


; custom dbus decorators
==== [https://launchpad.net/pymeta pymeta] parser-based controllers ====
: [http://dev.laptop.org/git?p=users/mstone/sds;a=blob;f=sds/service.py;hb=HEAD sds stub]


; ipython for exploring interprocess communication
See [http://dev.laptop.org/git?p=users/mstone/triagebot;a=blob;f=grammar.py;hb=grammar triagebot] for cute tricks.
: [http://ipython.scipy.org IPython] is wonderfully helpful for exploring xml-rpc and dbus interfaces.


; code to make pylint happy
==== Python GDB Macros ====
: rainbow's [http://dev.laptop.org/git?p=users/mstone/security;a=blob;f=rainbow/rainbow/inject.py;hb=cli inject.py] can be automatically checked for many errors by [http://www.logilab.org/project/pylint pylint] because it passes all data explicitly through function calls.


; C error handling
http://wiki.python.org/moin/DebuggingWithGdb
: [http://dev.laptop.org/git?p=users/mstone/nss-rainbow;a=tree nss-rainbow] uses a dash of code-generation and a lot of convention to be very consistent about error detection and handling.


; C warning flags & Makefile tips
==== Tree-based python context management ====
: nss-rainbow's [http://dev.laptop.org/git?p=users/mstone/nss-rainbow;a=blob;f=Makefile;hb=HEAD#l2 Makefile] gets a number of things right, though it can still be improved in several ways.


; scripts for user creation
[http://dev.laptop.org/git?p=users/mstone/puritan;a=blob;f=main.py;hb=f9#l16 puritan's main.py]
: [http://dev.laptop.org/git?p=users/mstone/provisioning;a=tree provision] users on new machines in a scripted fashion.


; program with git
==== Eschew object-orientation ====
: [[Puritan]] and other parts of our [[build system]] show some silly things you can do with [http://git.or.cz git] if you are so inclined.


; localize shell code
rainbow's [http://dev.laptop.org/git?p=users/mstone/security;a=blob;f=rainbow/rainbow/inject.py;hb=cli inject.py] can be automatically checked for many errors by [http://www.logilab.org/project/pylint pylint] because it passes all data explicitly through function calls.
: [http://dev.laptop.org/git?p=users/cjb/xs-rsync;f=xs-upserv;a=blob xs-upserv] - just for kicks: a localized Makefile

Latest revision as of 22:54, 6 March 2011

This page contains pointers to a collection of idioms which I rely on to accomplish tasks quickly and with predictable results.

verbose python tracebacks
import cgitb; cgitb.enable(format="plain")
verbosity controls on logging
See trac_helper.py
pythonic relations
See my relation module and Alloy (which was my inspiration, though I've made nothing more than a poor knockoff).
relational error logging
See trac_helper.py and collect-pkgs.py.
email-based error reporting
See email_warnings.py.
pdb
from pdb import set_trace as debug ... debug()
rpm makefiles
See rpm-packaging as well as individual projects like olpc-netutils along with my Fedora packaging bibliography.
pymeta parser-based controllers
triagebot is based on a model-view-controller architecture where the controller object is assembled at runtime based on data collected with a metaclass.
pymeta makes it easy to pick the right response to complicated input.
python gdb macros
http://wiki.python.org/moin/DebuggingWithGdb
python memory profiling
guppy + Tomeu's memory leak testing writeup.
tree-based python context management
puritan's main.py and contexts.py
custom dbus decorators
sds stub
ipython for exploring interprocess communication
IPython is wonderfully helpful for exploring xml-rpc and dbus interfaces.
code to make pylint happy
rainbow's inject.py can be automatically checked for many errors by pylint because it passes all data explicitly through function calls.
C error handling
nss-rainbow uses a dash of code-generation and a lot of convention to be very consistent about error detection and handling.
C warning flags & Makefile tips
nss-rainbow's Makefile gets a number of things right, though it can still be improved in several ways.
scripts for user creation
provision users on new machines in a scripted fashion.
program with git
Puritan and other parts of our build system show some silly things you can do with git if you are so inclined.
localize shell code
xs-upserv - just for kicks: a localized Makefile