CURRICULUM VITAE

Jennifer E. Balogh, Ph.D.
EDUCATION

Ph.D. Psychology, University of California, San Diego, 2003
Dissertation: Pronouns, Prosody, and the Discourse Anaphora Weighting Approach

M.A. Psychology, University of California, San Diego, 1998

B.A. English and American Literature, Cognitive Science and Linguistics minor, Brandeis University, 1994
PROFESSIONAL EXPERIENCE
2009 - present Manager
Intelliphonics, LLC, Menlo Park, CA

Founded consulting company specializing in the design, development, and evaluation of language systems. Serving as manager of the company. Consulting services include designing usability studies, designing, running, and analyzing results of experiments comparing dialog design approaches for speech recognition applications, and giving presentations.

2004 - 2007 Test Development Manager (June 2005 - August 2007)
Ordinate Corporation, a wholly-owned subsidiary of Harcourt Assessment, Menlo Park, CA

Led the design and development of language proficiency tests and oral reading assessments that use speech recognition technology for automatic administration and scoring.  Managed group of three employees and about 10 contractors and consultants. Developed and managed budget of 1.5 million.  Reviewed employee performance.  Served as project manager for customer projects.  Created project schedules. Hired, trained, and monitored consultants and contractors.  Presented at conferences and wrote journal articles.

Senior Test Developer (May 2004 - May 2005)

Designed spoken language tests and oral reading assessments.  Wrote item specifications.  Wrote and reviewed test items. Coordinated engineering efforts.  Conducted validation experiments, analyzed data, and wrote technical reports.  Created score concordance tables. 

1998 - 2004 Senior Professional Services Consultant / Dialog Researcher
Nuance Communications, Menlo Park, CA

Worked extensively on all phases of speech application projects: gathered requirements from customers, wrote requirements documents, designed dialogs including call flows, prompts and dialog specifications, coached voice talent, conducted usability studies, optimized system performance through grammar and parameter tuning, and evaluated deployed systems by monitoring calls, analyzing task completion rates, and conducting user surveys. Contributed to deployments for companies such as MCI, AT&T, TELUS, British Telecom, Fidelity, Charles Schwab, TD Waterhouse, and Chase.  Designed dialogs and conducted usability studies for Nuance products including Nuance Call Steering, Vocalizer (TTS engine), Voyager (voice browser) and SpeechObjects.

Co-wrote book of dialog design best practices called Voice User Interface Design (Addison-Wesley 2004). Researched dialog design techniques for spoken language systems. Designed materials for experiments, recruited and ran subjects, and analyzed data.  Presented findings within company and to scientific community at conferences. Helped develop Dialog Design Certification Exam. Managed budgets and schedules, trained and worked with outside contractors to localize products.
1994 - 1996 Research Assistant
Aphasia Research Center, VA Hospital, Boston, MA

Worked with aphasic patients to research how language is organized in the human brain.  Designed experiments, developed stimuli, recruited and screened patients, traveled on-site to run patients in studies, performed statistical analyses, and wrote articles for academic journals. Assisted with grant writing.
1994 - 1996 Co-founder and Director
Phaedrus Internet Development, Inc., Newtonville, MA

Co-founded small Web site design and consultant company.  Managed office and handled all accounting and business matters including transitioning the company from a partnership to a corporation. Developed web sites for businesses - wrote HTML, designed graphic art and edited copy.  Served as client contact.
1992 - 1994 Editorial Assistant
Charlesbridge Publishing Co., Watertown, MA

Edited and developed elementary school reading and writing programs. Edited fiction and non-fiction children’s trade books and Spanish translations.  Developed manuals for a one-day teacher's seminar on critical thinking with Educational Testing Service.
HONORS AND AWARDS
Above and Beyond Award 2004 (Nuance), Best Usability Engineer 2004 (Nuance), NSF Graduate Fellowship Honorable Mention 1997 (UCSD), Summa Cum Laude 1994 (Brandeis), Degree with Highest Honors 1994 (Brandeis), Phi Beta Kappa 1994 (Brandeis), Andrew Grossbardt Memorial Poetry Prize 1993 (Brandeis), Pushcart Prize Nominee 1993, John P. Schaffer Scholarship 1990, Presidential Fitness Award 1990.
GRANTS AND FELLOWSHIPS
Center for Research in Language Training Fellowship, Fall 1997 - Spring 1998.

Graduate Student Research Support Grant, Fall 1996.
PUBLICATIONS
Books

      Cohen, M.C., Giangola, J. & Balogh, J. (2004). Voice User Interface Design. Boston, MA: Addison-Wesley.


Book Chapters
 
      Balogh, J. & Bernstein, J. (2007). Workable models of standard performance in English and Spanish.  In Y. Matsumoto, D. Oshima, O. Robinson, and P. Sells (Eds.) Diversity in Language: Perspectives and Implication. Palo Alto, CA: CSLI Publications, Stanford.

      Balogh, J. & LeDuc, N. (2004). Designing voice applications.  In R. Longoria (Ed.) Designing for the Mobile Context.

      Balogh, J.E. & Grodzinsky, Y. (2000). Levels of linguistic representation in Broca's aphasia: Implicitness and referentiality of arguments. In R. Bastiaanse & Y. Grodzinsky (Eds.) Grammatical disorders in aphasia: A neurolinguistic perspective, London: Whurr Publishers, 88-104.


Refereed Journal Articles

      Balogh, J., Barbier, I., Bernstein, J., Suzuki, M., & Harada, Y. (2005). A common framework for developing automated spoken language tests in multiple languages. Japanese Journal for Research on Testing (JART), 1(1), 67-79.

      Sheeder, T. & Balogh, J. (2003).  Say it like you mean it: Priming for structure in caller responses to a spoken dialog system.  International Journal of Speech Technology, 6, 103-111.

      Cooke, A., Zurif, E.B., DeVita, C., Alsop, C., Koenig, P., Detre, J., Gee, J., Pinango, M., Balogh, J., Grossman, M. (2002). Neural basis for sentence comprehension: Grammatical and short-term memory components. Human Brain Mapping, 15(2), 80-94.

      Balogh, J., Zurif, E., Prather, P., Swinney, D., & Finkel, L. (1998). Gap-filling and end-of-sentence effects in real-time language processing: Implications for modeling sentence comprehension in aphasia. Brain and Language, 61, 169-182.
      

Refereed Conference Papers and Posters

      Balogh, J., Bernstein, J., Cheng, J., Townshend, B. (2007). Automatic evaluation of reading accuracy: Assessing machine scores. Paper presented at the Speech and Language Technology in Education Workshop, Farmington, PA.

      Balogh, J., Bernstein, J., Suzuki, M., Lennig, M. (2006). Automatically scored spoken language tests for air traffic controllers and pilots. Paper presented at the International Aviation Training Symposium (IATS), Oklahoma City.

      Balogh, J. (2006). Predicting oral reading rate and accuracy from a subjective measure of expressiveness. Poster presented at the 13th Annual Meeting of the Society of the Scientific Study of Reading (SSSR), Vancouver, Canada.

      Salting, D., Balogh, J. & Nair, A. (2006). Predictors of item difficulty in an automated spoken English test. Paper presented at the 28th annual meeting of the Language Testing Research Colloquium of the International Language Testing Association, Melbourne, Australia.

      Blake, R., Cetto, M., Ballester, C. & Balogh, J. (2006). Assessing oral proficiency for L2 Spanish: Classroom vs. DL courses. Presented at AAAL, Montreal.

      Blake, R., Ballester C., Cetto, M., & Balogh, J. (2006). Assessing proficiency of L2 Spanish students in hybrid and virtual courses. CALICO, Hawaii.

      Balogh, J. & Perkins, C. (2006). Using speech recognition technology to assess oral reading fluency. Presented at the 51st Annual Convention of the International Reading Association (IRA), Chicago, Illinois.

      Balogh, J. (2006). An evidence-based approach to the assessment of oral reading fluency. Poster presented at the 51st Annual Convention of the International Reading Association (IRA), Chicago, Illinois.

      Balogh, J., Bernstein, J., & Suzuki, M. (2006). Assessment of ESL high school students using Versant for English, an automated spoken English test. Poster presented at the 7th annual conference of the Association of Test Publishers (ATP), Orlando, Florida.

      Balogh, J., Strucker, J., & Bernstein, J. (2005). Predictors of reading fluency. Poster presented at the 12th annual meeting of the Scientific Study of Reading (SSSR), Toronto, Canada.

      Rosenfeld, E., Bernstein, J., & Balogh, J. (2005). Validation of an automatic measurement of Spanish speaking proficiency. Poster presented at the 149th meeting of the Acoustical Society of America (ASA), Vancouver, Canada.

      Balogh, J., Bernstein, J., Barbier, I., & Rosenfeld, E. (2005). The impact of native accent on a computerized assessment of pronunciation.  Poster presented at the 1st Acoustical Society of America (ASA) Workshop on Second Language Speech Learning, Vancouver, Canada.

      Balogh, J. (2005). A Common testing framework for computerized spoken language tests in multiple languages.  Paper presented at the 2nd annual conference of the Association of Language Testers in Europe (ALTE), Berlin, Germany.

      Balogh, J. (2005). Use of performance patterns for appropriate assessment. Paper presented at the 39th annual convention of Teachers of English to Speakers of Other Languages (TESOL), San Antonio, TX.

      Balogh, J., Barbier, I., Bernstein, J., & Suzuki, M. (2004). Pre- and post- testing using a computerized spoken English test (SET-10). Paper presented at the 6th annual conference of the Mid-West Association of Language Testers (MwALT), Dayton, OH. 

      Balogh, J., Bernstein, J., Barbier, I., & Rosenfeld, E. (2004). Relating automatic spoken Spanish score to the ILR scale. Paper presented at the 2nd annual conference of the East Coast Organization of Language Testers (ECOLT), Washington D.C.

      Balogh, J. & Swinney, D. (2004). The On-Line Processing of Contrastive Stress in Pronoun Referent Resolution.  Proceedings of 17th Annual CUNY Conference on Human Sentence Processing.

      Balogh, J. & Swinney, D. (2004). Pitch Accent’s Interaction with Other Cues of Salience in Pronoun Referent Resolution.  Proceedings of 17th Annual CUNY Conference on Human Sentence Processing.

      Balogh, J., LeDuc, N., & Cohen, M.H. (2001). Navigating the voice web. Proceedings of UAHCI 2001, Universal Access in Human-Computer Interaction, 242-246.

      Balogh, J. (2001). Strategies for concatenating recordings in a voice user interface: What we can learn from prosody. Extended Abstracts, CHI 2001, 249-250.

      Cooke, A., Zurif, E., DeVita, C., McSorley, C., Alsop, D., Gee, J., Detre, J., Koenig, P., Glosser, G., Balogh, J., Pinango, M., Gupta, H., Grossman, M. (1999). Functional neuroimaging of sentence comprehension. Proceedings of Cognitive Neuroscience, 1999, Journal of Cognitive Neuroscience, 11, 51.

      Balogh, J., Swinney, D. & Tigue, Z. (1998). Real-time Processing of Pronouns with Contrastive stress. Proceedings of 11th Annual CUNY Conference on Human Sentence Processing, New Brunswick, 126.

      Balogh, J., Swinney, D. & Tigue, Z. (1998). Sensitivity to Contrastive Stress: A Study of Individual Differences, Proceedings of 11th Annual CUNY Conference on Human Sentence Processing, New Brunswick, 77.

      Balogh, J. & Grodzinsky, Y. (1996). Varieties of passives in agrammatic Broca's aphasia: Theta grids, arguments, and referentiality. Proceedings of the 34th Annual Academy of Aphasia, 1996, London England. Brain and Language, 55(1), 54-56.
SPEAKING INVITATIONS AND LECTURES
"Techniques for Testing Speech Applications," Workshop: Meeting Business Objectives Through Speech Usability, SpeechTek 2002, New York, NY, November 2002.

"Ten Things Users Do That Designers Should Never Forget," V-World, Orlando, FL, April 2002.

"Voice Interfaces and the Web." with Nicole LeDuc. Special Lecture Series in Computer Science. Dr. Benjamin Wells, Instructor, USF, San Francisco, CA, Spring 2002.

"Giving a Voice to User Interfaces," with Nicole LeDuc, BayCHI, Palo Alto, CA, November 2001.

“Human Computer Interaction,”  Series of lectures for Symbolic Systems Course 115, Spoken Language Understanding Systems taught by Dr. Michael Cohen. Stanford University, Palo Alto, CA, Spring 2001.

"Principles of Effective Dialog Design," with Michael Cohen, Ph.D., V-World, San Diego, CA, May 2001.

"Acquisition of Syntax." Language Aquisition, Dr. Roberto Heredia, Instructor. University of San Diego, San Diego, CA, Spring 1998.

"Methodological Techniques with Special Populations: Children and Patients with Neurological Disorder." Methodology, Dr. Roberto Heredia, Instructor. University of San Diego, San Diego, CA, Spring 1997.
PATENTS
Cohen, M.H., Heck, L.P., Balogh, J.E., Riseman, J.M., Mirghafori, N.N. (2007). Detection of characteristics of human-machine interactions for dialog customization and analysis.  US Patent No. 7,263,489.

Cohen, M.H., Balogh, J.E., Wax, T.D., Thirumalai, M.S., Ghosh, D. (2003). Method and apparatus for providing active help to a user of a voice-enabled application.  US Patent No. 6,560,576.
ACTIVITIES
Workshop leader and curriculum designer for GetSET, a program to encourage high school girls to pursue science and engineering.

ESL tutor for Project Literacy.

Puzzle published in GAMES Magazine.

Poems published in Aberations, Artemis, Empyrean Brew, Gatherings, Kether, Laurel Moon, Mind in Motion, Parting Gifts, Poetry Forum Journal, and Sacred River.

Bookclub member

Phonemic Awareness Game

TOEFL Speaking Tips