User experience data on betterdesktop.org

Python snippet to get data in structured form from the betterdesktop.org which delegates information done on user experience tests.

Code highlighted in gedit:

Code itself:

#############################################################
### Protected and shared under GPL v2.0 license
### see: http://www.gnu.org/licenses/gpl-2.0.html
###
###
### Python code to gather structured information about
###   the work done as described on
###                       http://www.betterdesktop.org
###  which is great and promising about user experience
###                                    on free software
###
### edit: Dincer Kavraal
### mail: under "gmail.com" user "dkavraal"
#############################################################

from BeautifulSoup import BeautifulSoup
import urllib2

#------ init
print "Downloading...",
pageContent = urllib2.urlopen('http://www.betterdesktop.org/wiki/index.php?title=Data')
print "Done.\nRevealing...",
pageDom = BeautifulSoup(pageContent)
print "Done."
print "Content charcode:", pageDom.originalEncoding

#------ get all table:video-table
resultSet=[]
taskId=0
tables=pageDom.findAll("table", {"class": "video-table"})
for table in tables:
        pId=0
        resultSet.append([])
        resultSet[taskId].append(table.findPrevious('h3').string)
        for lineTag in table.findAll('tr'):
                arrayForPeopleCrted=False
                for columnTag in lineTag.findAll('td'):
                        if not(arrayForPeopleCrted):
                                pId+=1
                                resultSet[taskId].append([])
                                resultSet[taskId][pId] = []
                                arrayForPeopleCrted=True
                        if columnTag.find('a'):
                                resultSet[taskId][pId].append(columnTag.find('a').get('href'))
                        else:
                                resultSet[taskId][pId].append(columnTag.string.rstrip(' \n\r').lstrip(' \r\n'))
        taskId+=1
print "Total tasks processed: ", taskId
print

#------  print out summary table
taskId=0
for task in resultSet:
        taskId+=1
        print "---------------------------------------"
        print "".join(["[", str(taskId), "] ", task[0]])
        for pId in range(1, len(task)-1):
                print "".join(["\t\t", task[pId][3][0], task[pId][1], "(", task[pId][2], ")"])

#------ done.

Sample output:

---------------------------------------
[66] Task: Accept the offer to share an iFolder
		M18-30(9/10)
		M30-40(9/10)
		F18-30(5/10)
		M18-30(9/10)
		M18-30(9/10)
		M18-30(4/10)
		M18-30(9/10)
		M18-30(9/10)