I want to see if I can get a paper into the 6th Conference on Email and Anti-Spam. Deadline for papers is 2009-04-15.

I thought I'd have problems with 4TB of web data. These researchers have 60TB to play with.

Distracted. I should have written my book sooner.

AttentionStream (TM). Mining Behavioral Attention Data to Improve Collaboration. Where's the research?

It might be interesting to model Ravichandran, N World Class Logistics Operations: The Case of Bombay Dabbawallahs

Randy Pausch Time Management 0:24.45 Does anyone here have an e-mail inbox sorted by importance? This is my PhD topic. Defining what importance means and applying it to the items in the universal inbox.

Designing a More Effective Inbox has some statistics but I don't think they have the solution. They also use utilize or utilized five times which makes me suspicious of their claims. They also references but no in-text citations and claim to have patented a process or algorithm. Paul Graham has an interesting essay on software patents.

Franklin, M, Halevy, A & Maier, D (2005) From Databases to Dataspaces: A New Abstraction for Information Management might have relevance to online business group behaviour. I know there is a lot of work on organisational behaviour that I need to reference but mostly stay away from.

I'm interested in Reality Mining. My application is to capture the behaviour that makes Organisational Memory or is applied by Group Intelligence.

Clay Shirky's talk about the importance of inconvenience in online social network design. Social networks need barriers to entry to get the right motivation or shared vision.

I've moving the focus of my PhD to utility of interruption for a model of the universal inbox. Still has elements of Attention, Reputation and Trust. Here's an interesting article on Time and Attention. More at Inbox Zero.

Transcript of discussion with Ioannidis and Norman Swan.

John P.A. Ioannidis Why Most Published Research Findings Are False. PLoS Medicine August, 2005;2;8:696-700

Interesting post from Mark Guzdial quoting Alan Kay's thoughts about teaching computing sent to Bill Kerr.

One of the elements of Shannon's general model of communication is noise. Here's an interesting article about Online Noise.

I was looking at an old post 10 ways to keep online dialogue on topic by Alexandra Samuel found after watching the Gruentransfer. I realised the anti-ads were an example Culture Jamming. I've been thinking how to handle virtual workshops for distance education students. Maybe if I could get them to use a Presence tool such as those developed using the Extensible Messaging and Presence Protocol. If a sufficient number of students indicated they were present and I was also "available" I would hold a class. The agenda could be developed like an Unconference or something formal already prepared. The group size necessary to activate the class would be a quorum. Students would be welcome to gather in the virtual space but I would choose to start the class.
Interesting presence ideas

I think I'm interested in Reality Mining. This is a form of Data Mining but analysing people's behaviour in real-time.

I want to get into playing with data like this Six Degrees of Wikipedia. I'll have to soon with the continuation from the Separating the wheat from the chaff: identifying key elements in the NLA .au domain harvest paper.

Sometimes Crowds Aren't That Wise" by Josh Catone. I downloaded the PDF file in question. No it didn't check the version of Photoshop I'm using. I don't use Photoshop. I use http://gimp.org.

Distributed Reputation Systems for Internet-based Peer-to-Peer Systems and Mobile Ad-Hoc Networks by Jochen Mundinger, Sonja Buchegger and Jean-Yves Le Boudec. Reputation systems are widely and successfully used in centralized scenarios. Will they work equally well, however, in decentralized scenarios such as Internet-based peer-to-peer systems and mobile ad hoc networks?
Jean-Yves Le Boudec Artificial Immune System For Collaborative Spam Filtering
Summary. Artificial immune systems (AIS) use the concepts and algorithms inspired by the
theory of how the human immune system works. This document presents the design and initial
evaluation of a new artificial immune system for collaborative spam filtering1 .
Collaborative spam filtering allows for the detection of not-previously-seen spam content,
by exploiting its bulkiness. Our system uses two novel and possibly advantageous techniques
for collaborative spam filtering. The first novelty is local processing of the signatures cre-
ated from the emails prior to deciding whether and which of the generated signatures will
be exchanged with other collaborating antispam systems. This processing exploits both the
email-content profiles of the users and implicit or explicit feedback from the users, and it uses
customized AIS algorithms. The idea is to enable only good quality and effective information
to be exchanged among collaborating antispam systems. The second novelty is the represen-
tation of the email content, based on a sampling of text strings of a predefined length and at
random positions within the emails, and a use of a custom similarity hashing of these strings.
Compared to the existing signature generation methods, the proposed sampling and hashing
are aimed at achieving a better resistance to spam obfuscation (especially text additions) -
which means better detection of spam, and a better precision in learning spam patterns and
distinguishing them well from normal text - which means lowering the false detection of good
emails.
Initial evaluation of the system shows that it achieves promising detection results under
modest collaboration, and that it is rather resistant under the tested obfuscation. In order to
confirm our understanding of why the system performed well under this initial evaluation,
an additional factorial analysis should be done. Also, evaluation under more sophisticated
spammer models is necessary for a more complete assessment of the system abilities.

In the Basement of the Ivory Tower struck a chord with me. Here's a summary:

No one has drawn up the flowchart and seen that, although more-widespread college admission is a bonanza for the colleges and nice for the students and makes the entire United States of America feel rather pleased with itself, there is one point of irreconcilable conflict in the system, and that is the moment when the adjunct instructor, who by the nature of his job teaches the worst students, must ink the F on that first writing assignment.

...For I, who teach these low-level, must-pass, no-multiple-choice-test classes, am the one who ultimately delivers the news to those unfit for college: that they lack the most-basic skills and have no sense of the volume of work required; that they are in some cases barely literate; that they are so bereft of schemata, so dispossessed of contexts in which to place newly acquired knowledge, that every bit of information simply raises more questions.

(created by SummaryService 1.2.1)

Just watched a Google video featuring Peter Norvig on large data and analysis. Some amazing results. This and lots of interesting IT posts at http://catonmat.net.