Expect is a tool for automating interactive applications such as
telnet, ftp, passwd, fsck, rlogin, tip, etc. Expect really makes this
stuff trivial. Expect is also useful for testing these same
applications. And by adding Tk, you can also wrap interactive
applications in X11 GUIs.
Expect can make easy all sorts of tasks that are prohibitively
difficult with anything else. You will find that Expect is an
absolutely invaluable tool - using it, you will be able to automate
tasks that you've never even thought of before - and you'll be able to
do this automation quickly and easily.
Ok - enough of the hype. More information on Expect is
available in the following documents:
Obtaining Expect
You can get Expect and the examples from expect.nist.gov as expect.tar.Z or expect.tar.gz.
The gz file is preferrable simply because it is quicker to download.
However, if you have no idea what to do with a gz file once you've got
it, just transfer the Z version of the distribution. Then, at the
command line, type:
uncompress expect.tar.Z
tar -xvf expect.tar
This will create a directory containing the Expect distribution.
Change to that directory and read the README file.
Note 1: Expect requires Tcl. If you don't already have Tcl, you
can get it as tcl.tar.Z
or gz. To install Tcl,
just mimic the instructions as for Expect.
Note 2: If you want to download Expect (or Tcl) without using a
web browser, you will need to know the ftp-style URLs. Yes, they're
a lot longer and clumsier than the web-style URLs. The ftp URLs are:
ftp://ftp.nist.gov/mel/div826/subject/expect/expect.tar.gz (or .Z)
ftp://ftp.nist.gov/mel/div826/subject/tcl.tar.gz (or .Z)
Obtaining the examples
The distribution contains many example scripts, including many
well-known scripts such as kibitz, rftp (recursive ftp), passmass,
autoexpect and the delicious beer script. All of the substantive
examples in the book are included and many of them have man pages
themselves.
To obtain the examples, follow the directions for obtaining Expect
(above). Once you have received and unpacked the distribution, you
can find the examples in the example directory.
The following are some other particularly worthwhile Expect-related
links.
- DejaGnu
is a popular Expect-based framework for testing other programs. If
you are starting out and feel overwhelmed by the capabilities of
Expect or would just like some guidance on how to structure a test
suite, check out DejaGnu. DejaGnu is used by many standards testing
organizations.
- WINTERP
is a rapid prototyping, development and delivery
environment for GUI-based applications on Unix platforms. WINTERP uses
Lisp instead of Tcl.
-
expy is the Expect library embedded in Python instead of Tcl.
- ICE Tcl/Tk is a true
compiler for Tcl/Tk. It also includes support for Expect.
- Neosoft
Integrated Tcl Release is an integrated collection of Tcl, Expect,
and several other extensions:
- tcl7.5p1
- tk4.1
- itcl2.1 (with itcl subdirs removed, includes iwidgets)
- tclX7.5.3-a1
- expect-5.20
- dp3.5beta2
- gd1.2 (a graphics drawing library)
- neo7.5.1p1 (neosoft-authored tcl Extensions, also includes db.1.85)
Here are a couple links to pages describing projects written
using Expect.
- Developing
Graphical User Interfaces describes how one lab (unrelated to
mine!) at NIST applied Tcl/Tk/Expect to a variety of projects.
- WebDataplot -
Dataplot is a public-domain system for scientific visualization,
statistical analysis, and non-linear modeling.
- WWW-based
user interface to the Virginia Tech Library System (VTLS). This
service interacts with VTLS using VTLS-commands via a
telnet-connection. (Originally you had to understand Finnish, but
it's now available in English!)
- Drone is
a tool for automatically running batch jobs of a simulation program.
Allows sweeps over arbitrary sets of parameters, as well as multiple
runs for each parameter set, with a separate random seed for each run.
Runs may be executed either on a single computer or over the Internet
on a set of remote hosts.
- Performance
Management in an RDBMS Environmentexplores DB performance
management can be enhanced using, of course, Expect (as well as some
less important tools :-)
"Exploring Expect" is an excellent resource for learning and
using Expect. (Pub: O'Reilly, ISBN 1-56592-090-2) The book contains
hundreds of examples and also includes a tutorial on Tcl. Exploring
Expect is 602 pages.
NIST policy is to avoid endorsements for commercial products or
organizations. Hence this page provides no link for the publisher
or any further information about how to obtain the book.
Articles, Papers, and Chapters on Expect
- Libes, D., "Expect", Tcl/Tk Extensions, ed, Mark Harrison, O'Reilly
& Associates, Inc., 1997.
- Libes, D.,
Writing a Tcl Extension in Only ... 7 Years, Proceedings of the
Fifth Annual Tcl/Tk Workshop '97, Boston, MA, July 14-7, 1997.
Winner of Best Paper Award at conference.
- Libes, D., "Tcl/Tk-based
Agents for Mail and News Notification -- or -- A Tale of Two
Biffs",
Software - Practice & Experience, John Wiley & Sons, West Sussex,
England, to appear. [This paper isn't really about Expect per se.
However, a large section of the paper is on tknewsbiff which is one of
the Expect examples.]
- Friesenhahn, B., "Expect Offers UNIX Scripting", Byte Magazine, April 1997.
- Libes, D., Automation and
Testing of Interactive Character Graphic Programs,
Software - Practice and Experience, Vol. 27(2), p 123-137,
February 1997.
- Libes, D., "How to Avoid Learning
Expect -- or -- Automating Automating Interactive Programs",
Proceedings of the Tenth USENIX System Administration Conference (LISA
X), Chicago, IL, September 30 - October 4, 1996.
- Libes, D., "Writing CGI
Scripts in Tcl", Proceedings of the Fourth Annual Tcl/Tk Workshop
'96, Monterey, CA, July 10-13, 1996. [This paper isn't really about
Expect per se. However, it does show a nice example of Expect in a
CGI script for the purpose of changing passwords through web pages.
The complete form/script can be found in the source distribution.]
Winner of Best Presentation Award at conference.
- Libes, D., Terminal
Emulation for Automation and Testing of Character Graphic Programs: A
Code Walkthrough, Proceedings of The 21st Annual Trenton Computer
Festival (TCF '96), Trenton, NJ, April 21-22, 1996 - a much longer and
more detailed version of the SP&E paper (above) [I submitted this
originally to SP&E and they cut it down to what ultimately appeared but
recommended that this version was still worth publishing elsewhere -
hence this second publication.]
- Faught, D., Testing Interactive Programs, Software QA
Magazine, Vol. 3, No. 1, February 1996.
- Fischer, P., The Expect Program
and Other Skunkware Tools, SCO World, February, 1996.
- Libes, D., Handling
Passwords with Security and Reliability in Background Processes,
Proceedings of the 1994 USENIX LISA VIII Conference, San Diego, CA,
September 19-23, 1994 - Simple techniques to allow secure handling of
passwords in background processes.
- Morse, W., A Tcl/Tk and Expect Tutorial, World Wide
Technology Conference, Houston, TX, December 1, 1994. Winner of
Best Paper Award at conference.
- Libes, D., Ouch, Those Programs Are Painful, ORA.COM,
O'Reilly & Associates, Inc., Fall '94.
- Libes, D., A
Debugger for Tcl Applications, Proceedings of the 1993 Tcl/Tk
Workshop, Berkeley, CA, June 10-11, 1993 - A presentation of the Tcl
debugger - theory, implementation, and use.
Warning: The examples in all of the papers listed
below here are archaic. Critical aspects (usually syntax) of both
Expect and Tcl have changed since they were written. (It's not that
Expect has changed that recently - rather it's because of incredibly
slow turnaround by many reviewers, editors, and journals.)
The papers still make interesting reading - just don't study the
examples too closely! Fortunately, most of the examples from the
papers also accompany the Expect distribution - and all of the online
examples are up to date.
- McNutt, D., Expect, January, 1994,
UNIX Review, Vol. 12, No. 6, January 1994 - Introductory article.
- Libes, D., X Wrappers
for Non-Graphic Interactive Programs, Proceedings of Xhibition
'94, San Jose, CA, June 20-24, 1994 - Discussion of wrapping
interactive programs with Tk.
- Dichter, C., Surviving Software
Testing, UNIX Review, pps 29-36, V11, #2, Feb 1993.
- Libes, D., Kibitz -
Connecting Multiple Interactive Programs Together, Software -
Practice & Experience, Vol. 23, No. 5, May 1993 - Paper on connecting
multiple interactive programs together using Expect.
- Libes, D., Obfuscated C and
Other Mysteries, Chapter 36 ("Expect"), John Wiley & Sons, ISBN
0-471-57805-3, January 1993 - An explanation of some of the more
interesting source code to an early version of Expect.
- Libes, D., Automating Interactive Applications in the Network
Environment, International Communications Association Journal, May
17, 1992.
- Smith, B., Software Corner, Byte Magazine, 1992.
- Caffrey, P., User Interfaces and Automating Computer Human
Interaction, MSc. Thesis, Amdahl Ireland Ltd., 1992.
- Woodson, B., Regression Testing Using Expect, How To
Implement Quality In Software Conference, Santa Clara Valley Software
Quality Association, June 29, 1991.
- Libes, D., Regression
Testing and Conformance Testing Interactive Programs, Proceedings
of the Summer 1992 USENIX Conference, San Antonio, TX, June 8-12, 1992
- Discussion of regression and conformance testing. If you are
interested in this, you should also check out DejaGnu.
- Libes, D., Expect:
Scripts for Controlling Interactive Programs, Computing Systems,
Vol. 4, No. 2, University of California Press Journals, 1991 - A nice
overview with a balance of example scripts and explanations.
- Libes, D., Implementor's
Notebook: Implementing a Trap Command, C Users Journal, Vol. 9,
No. 3, R&D Publications, Lawrence, KS, January, March, 1991 -
Explanation of how Expect's trap command was implemented.
- Libes, D., Implementor's
Notebook: Expect, C Users Journal, Vol. 9, No. 1, R&D
Publications, Lawrence, KS, January, January, 1991 - Explanation of
some of the more interesting source code to an early version of Expect
(an improved version of this appeared later as Obfuscated C and Other
Mysteries, Chapter 36 ("Expect").
- Anderson, D., "Expect", January, 1991, SunExpert Magazine,
Vol. 2, No. 1, January 1991 - Introductory article.
- Libes, D., Using Expect
to Automate System Administration Tasks, Proceedings of the 1990
USENIX Large Systems Administration Conference (LISA) IV, Colorado
Springs, CO, October 17-19, 1990 - Examples and discussion,
specifically aimed at system administrators.
- Libes, D., Expect:
Curing Those Uncontrollable Fits of Interaction, Proceedings of
the Summer 1990 USENIX Conference, Anaheim, CA, June 11-15, 1990 -
Discussion of Expect's implementation, philosophy, and some
performance notes.
Expect was conceived of in September, 1987. The bulk of version 2 was
designed and written between January and April, 1990. Minor evolution
occurred after that until Tcl 6.0 was released. At that time
(October, 1991) approximately half of Expect was rewritten for version
3. See the HISTORY file
for more information. The HISTORY file is included with the Expect
distribution.
Around January 1993, an alpha version of Expect 4 was introduced.
This included Tk support as well as a large number of enhancements. A
few changes were made to the user interface itself, which is why the
major version number was changed. A production version of Expect 4
was released in August 1993.
In October 1993, an alpha version of Expect 5 was released to match
Tcl 7.0. A large number of enhancements were made, including some
changes to the user interface itself, which is why the major version
number was changed (again). The production version of Expect 5
released in March '94.
There are important differences between Expect 3, 4, and 5. See the
CHANGES.* files in the distribution if you want to read about the
differences. Expect 4 has ceased further development and is not
supported. However, if for some reason you want the old code, it is
available from pub/expect/old as described above.
The Expect book became available in January '95. It describes Expect
5 as it is today, rather than how Expect 5 was when it was originally
released. Thus, if you have not upgraded Expect since before getting
the book, you should upgrade now.
Historical notes on Tcl and Tk according to John Ousterhout
I got the idea for Tcl while on sabbatical leave at DEC's
Western Research Laboratory in the fall of 1987. I started actually
implementing it when I got back to Berkeley in the spring of 1988; by
summer of that year it was in use in some internal applications of
ours, but there was no Tk. The first external releases of Tcl were in
1989, I believe. I started implementing Tk in 1989, and the first
release of Tk was in 1991.
- NICS - A service to allow
collaborative management of identifiers.
- cgi.tcl
- A comprehensive library for creating Tcl-based CGI scripts. cgi.tcl
supports tables, cookies, file upload, Expect, Tcl applets, Java, etc,
etc.
- tcl-debug
- A Tcl debugger. Provides traditional debugging capabilities to any
Tcl script. Built in to Expect but it works with any Tcl extension
including Tk. Can be dynamically loaded.
- tkbiff - allows
arbitrary commands (play audio clip, metamail, etc) to be executed
upon mail reception. (If you like xbiff++ but wish it were more
flexible or more portable, then you'll like tkbiff.) tkbiff is
flexible enough that you can make it do anything. Default behavior:
fast and convenient access to new email using very little screen real
estate.
- FAQ
builder - A very easy-to-use FAQ builder. Simplifies maintenance
of hyperlinks, automatically repeats the questions with links to the
answers, automatically produces different formats (currently only text
and html supported), etc.
- Stopwatch - A
little stopwatch - just right for helping you get the timing down
while practicing a talk. Provided both as an applet and a standalone
Tk script.
The following links have nothing specifically to do with Expect
but may be significant in their value to Expect users nonetheless: