Advanced Bash-Scripting Guide - upm.ro

1 Advanced bash scripting GuideAn in depth exploration of the art of shell scriptingMendel March 2002 Revision HistoryRevision June 2000 Revised by: mcInitial October 2000 Revised by: mcBugs fixed, plus much additional material and more example February 2001 Revised by: mcAnother major July 2001 Revised by: mcMore bugfixes, much more material, more scripts a complete revision and expansion of the September 2001 Revised by: mcMajor update. Bugfixes, material added, chapters and sections October 2001 Revised by: mcBugfixes, reorganization, material added. Stable January 2002 Revised by: mcBugfixes, material and scripts March 2002 Revised by: mcMore bugfixes, material and scripts tutorial assumes no previous knowledge of scripting or programming, but progresses rapidly toward anintermediate/ Advanced level of instruction (.)

2 All the while sneaking in little snippets of UNIX wisdom andlore). It serves as a textbook, a manual for self study, and a reference and source of knowledge on shellscripting techniques. The exercises and heavily commented examples invite active reader participation,under the premise that the only way to really learn scripting is to write latest update of this document, as an archived "tarball" including both the SGML source and renderedHTML, may be downloaded from the author's home site. See the change log for a revision Anita, the source of all the magicTable of ContentsChapter 1. Why Shell Programming?..1 Chapter 2. Starting Off With a Sha Invoking the Preliminary 2. 3. Exit and Exit 4. Special 5. Introduction to Variables and Variable Variable bash Variables Are Special Variable 6.

3 7. Test File test Comparison operators (binary).. Nested if/then Condition Testing Your Knowledge of 8. Operations and Related Numerical 3. Beyond the 9. Variables Internal Manipulating Manipulating strings using Further Parameter Typing variables: declare or Indirect References to $RANDOM: generate random The Double Parentheses 10. Loops and Nested Loop Testing and bash scripting GuideiTable of ContentsChapter 11. Internal Commands and Job Control 12. External Filters, Programs and Basic Complex Time / Date Text Processing File and Archiving Communications Terminal Control Math Miscellaneous 13. System and Administrative 14. Command 15. Arithmetic 16. I/O Using Redirecting Code 17. Here 18. Recess 4. Advanced 19.

4 Regular A Brief Introduction to Regular 20. 21. Restricted 22. Process 23. Complex Functions and Function Local Local variables make recursion 24. 25. List bash scripting GuideiiTable of ContentsChapter 26. 27. 28. /dev and 29. Of Zeros and 30. 31. 32. 33. scripting With Unofficial Shell scripting 34. Interactive and non interactive shells and Shell Tests and Comparisons: Assorted Portability Shell scripting Under 35. bash , version 36. Author's About the Tools Used to Produce This Software and A. Contributed B. A Sed and Awk Micro C. Exit Codes With Special D. A Detailed Introduction to I/O and I/O E. F. History G. A Sample .bashrc bash scripting GuideiiiTable of ContentsAppendix H. Converting DOS Batch Files to Shell I.

5 Analyzing Writing J. bash scripting GuideivChapter 1. Why Shell Programming?A working knowledge of shell scripting is essential to everyone wishing to become reasonably adept atsystem administration, even if they do not anticipate ever having to actually write a script. Consider that as aLinux machine boots up, it executes the shell scripts in / to restore the system configuration andset up services. A detailed understanding of these startup scripts is important for analyzing the behavior of asystem, and possibly modifying shell scripts is not hard to learn, since the scripts can be built in bite sized sections and there is onlya fairly small set of shell specific operators and options [1] to learn. The syntax is simple andstraightforward, similar to that of invoking and chaining together utilities at the command line, and there areonly a few "rules" to learn.

6 Most short scripts work right the first time, and debugging even the longer ones shell script is a "quick and dirty" method of prototyping a complex application. Getting even a limitedsubset of the functionality to work in a shell script, even if slowly, is often a useful first stage in projectdevelopment. This way, the structure of the application can be tested and played with, and the major pitfallsfound before proceeding to the final coding in C, C++, Java, or scripting hearkens back to the classical UNIX philosophy of breaking complex projects into simplersubtasks, of chaining together components and utilities. Many consider this a better, or at least moreesthetically pleasing approach to problem solving than using one of the new generation of high poweredall in one languages, such as Perl, which attempt to be all things to all people, but at the cost of forcing youto alter your thinking processes to fit the not to use shell scripts resource intensive tasks, especially where speed is a factor (sorting, hashing, etc.)

7 Procedures involving heavy duty math operations, especially floating point arithmetic, arbitraryprecision calculations, or complex numbers (use C++ or FORTRAN instead) cross platform portability required (use C instead) complex applications, where structured programming is a necessity (need typechecking of variables,function prototypes, etc.) mission critical applications upon which you are betting the ranch, or the future of the company situations where security is important, where you need to guarantee the integrity of your system andprotect against intrusion, cracking, and vandalism project consists of subcomponents with interlocking dependencies extensive file operations required ( bash is limited to serial file access, and that only in a particularlyclumsy and inefficient line by line fashion)

8 Need multi dimensional arrays need data structures, such as linked lists or trees need to generate or manipulate graphics or GUIs need direct access to system hardware need port or socket I/O need to use libraries or interface with legacy code proprietary, closed source applications (shell scripts are necessarily Open Source) If any of the above applies, consider a more powerful scripting language, perhaps Perl, Tcl, Python, orpossibly a high level compiled language such as C, C++, or Java. Even then, prototyping the application as ashell script might still be a useful development 1. Why Shell Programming?1We will be using bash , an acronym for "Bourne Again Shell" and a pun on Stephen Bourne's now classicBourne Shell. bash has become a de facto standard for shell scripting on all flavors of UNIX.

9 Most of theprinciples dealt with in this book apply equally well to scripting with other shells, such as the Korn Shell,from which bash derives some of its features, [2] and the C Shell and its variants. (Note that C Shellprogramming is not recommended due to certain inherent problems, as pointed out in a news groupposting by Tom Christiansen in October of 1993). The following is a tutorial in shell scripting . It relies heavily on examples to illustrate features of the shell. Asfar as possible, the example scripts have been tested, and some of them may actually be useful in real reader should use the actual examples in the the source archive (something or ),[3] give them execute permission (chmod u+rx scriptname), then run them to see what the source archive not be available, then cut and paste from the HTML, pdf, or text renderedversions.

10 Be aware that some of the scripts below introduce features before they are explained, and this mayrequire the reader to temporarily skip ahead for otherwise noted, the book author wrote the example scripts that bash scripting GuideChapter 1. Why Shell Programming?2 Chapter 2. Starting Off With a Sha BangIn the simplest case, a script is nothing more than a list of system commands stored in a file. At the very least,this saves the effort of retyping that particular sequence of commands each time it is 2 1. cleanup: A script to clean up the log files in /var/log # cleanup# Run as root, of /var/logcat /dev/null > messagescat /dev/null > wtmpecho "Logs cleaned up."There is nothing unusual here, just a set of commands that could just as easily be invoked one by one fromthe command line on the console or in an xterm.