Codetown ::: a software developer's community
Tags:
Commercial applications of computational linguistics have been growing by leaps and bounds. IBM created a new poster child for the field with their Jeopardy champion Watson, and most everyone has used Google Translate and/or Voice by now (and fewer yet will have escaped interacting with an Automated Voice Response system). Commercial segments making significant use of NLP include web marketing, medicine, biomedical research, finance, law, and customer call centers.
In the most general terms, computational linguistics is applying computational methods to problems in linguistics. Linguistics then is the study of human language in all its aspects. Although it hasn't received a lot of press until recently, computational linguistics has been around pretty much since the development of the computer. One of the first uses of digital computers (and a key impetus for their development) was in code breaking, which is an application of "compling" (I know, it looks like a typo for "compiling" but CL looks like Common LISP to me). The Association for Computational Linguistics (ACL), the largest and oldest scientific and profssional society in the field, will hold its 50th annual conference next July.
Being such a broad field there are of course many specializations and various communities with differing objectives and vocabularies. Folks primarily focused on engineering computer systems that process human language at a level deeper than simply character strings are generally under the Natural Language Processing (NLP) banner. The commercial success of CL applications and the focus on some problems other than the traditional NLP ones (translation, text understanding, and speech recognition and generation) has spawned Text Analytics as another subfield that is closely associated with Business Intelligence (itself largely commercial application of machine learning methods). Perhaps the biggest focus of Text Analytics has been on sentiment analysis, which assesses a speaker's attitude or mood in something they've said or written (we usually say "speaker" even when the medium is written or typed). There are many businesses that use sentiment analysis on the web to find out what folks are saying about them and their products, in call centers for quality control, and in finance to predict future prices. Applications in law and government include "e-discovery" and smart OCR systems. Lastly, and far from leastly, is compling in the medical field and the specialized domain knowledge it calls for which is known as bioinformatics. Bioinformatics may well be compling's "killer app" because of the tremendous opportunity to do good. Answering technical questions for medical practitioners is the application IBM has targeted as Watson's "day job".
This is a big topic and I have lots I would like to say, so I intend to drop in here often. So stay tuned!
~~~~ Jim White
On a similar note: This fall a colleague of mine informed me of a class being offered by two Standford professors. It is Introduction to Artifical Intelligence (ai-class.com). I signed up for the course along with 138,000 other students. It has been interesting to see some of the therories and formulas used to help the computer find the correct answer. Prior to starting the class, I did not realize it is mostly related to statistics. I just finished the midterm and will hopfully learn alot more as the course continues.
Next semester Stanford is offering a wider variety of online courses. One of them is specifically on natural language processing:
There are also some other courses that would make good follow-ups to the AI course.
Machine learning: http://jan2012.ml-class.org/
Probabilistic graphical models: http://www.pgm-class.org/ (These are the kinds of graphs you saw in the AI course - not about pictures)
Game theory: http://www.game-theory-class.org/
Excellent. Thanks, Eric!
Eric Lavigne said:
Next semester Stanford is offering a wider variety of online courses. One of them is specifically on natural language processing:
There are also some other courses that would make good follow-ups to the AI course.
Machine learning: http://jan2012.ml-class.org/
Probabilistic graphical models: http://www.pgm-class.org/ (These are the kinds of graphs you saw in the AI course - not about pictures)
Game theory: http://www.game-theory-class.org/
Codetown is a social network. It's got blogs, forums, groups, personal pages and more! You might think of Codetown as a funky camper van with lots of compartments for your stuff and a great multimedia system, too! Best of all, Codetown has room for all of your friends.
Created by Michael Levin Dec 18, 2008 at 6:56pm. Last updated by Michael Levin May 4, 2018.
Check out the Codetown Jobs group.

Pinterest Engineering cut Apache Spark out-of-memory failures by 96% using improved observability, configuration tuning, and automatic memory retries. Staged rollout, dashboards, and proactive memory adjustments stabilized data pipelines, reduced manual intervention, and lowered operational overhead across tens of thousands of daily jobs.
By Leela Kumili
Franka Passing discusses the architectural shift of Duolingo’s 500+ backend services to Kubernetes. She explains the move toward GitOps with Argo CD, the transition to IPv6-only pods, and the "cellular architecture" used to isolate environments. She shares "reports from the trenches" on managing developer trust, navigating AWS rate limits, and productionizing early adopter services.
By Franka Passing
How can you focus in a sea of results from a large regression test suite? This article describes a stochastic approach that relies on some degree of redundancy in your CI regression test set. This approach does not guarantee you will catch every bug every time, but it gives you your best bet of not missing the subtle signatures of all the bugs uncovered by your CI regression test suite runs.
By James Bornefelt WestfallIn this episode, Thomas Betts and Adi Polak talk about the need for context engineering when interacting with LLMs and designing agentic systems. Prompt engineering techniques work with a stateless approach, while context engineering allows AI systems to be stateful.
By Adi Polak
A 600-run benchmark by Ruby committer Yusuke Endoh tested Claude Code across 13 languages, implementing a simplified Git. Ruby, Python, and JavaScript were the fastest and cheapest, at $0.36- $0.39 per run. Statistically typed languages cost 1.4-2.6x more. Adding type checkers to dynamic languages imposed 1.6-3.2x slowdowns. Full dataset available on GitHub.
By Steef-Jan Wiggers
© 2026 Created by Michael Levin.
Powered by