SlideShare ist ein Scribd-Unternehmen logo
1 von 51
How Can I Get My Paper
Accepted at a Top SE
Conference?
Alessandro (Alex) Orso
Georgia Institute of Technology, USA
http://www.cc.gatech.edu/~orso/
Sebastian Uchitel
University of Buenos Aires,AR
Imperial College London, UK
http://lafhis.dc.uba.ar/~suchitel/
Before we start...
• We asked for input from colleagues in the community...
Before we start...
• We asked for input from colleagues in the community...
• “OMG, this is such a difficult task!”
• “There is no recipe”
• ...
Before we start...
• We asked for input from colleagues in the community...
• “OMG, this is such a difficult task!”
• “There is no recipe”
• ...
• But there are some general, shared principles
Before we start...
• We asked for input from colleagues in the community...
• “OMG, this is such a difficult task!”
• “There is no recipe”
• ...
• But there are some general, shared principles
➡ Our goal is not to give you a recipe, but to share (our and
others’) principles and experience accumulated as
• researchers, writers, and advisors
• associate editors of TSE and TOSEM
• conference program chairs
• program committee members
Before we start...
• We asked for input from colleagues in the community...
• “OMG, this is such a difficult task!”
• “There is no recipe”
• ...
• But there are some general, shared principles
➡ Our goal is not to give you a recipe, but to share (our and
others’) principles and experience accumulated as
• researchers, writers, and advisors
• associate editors of TSE and TOSEM
• conference program chairs
• program committee members
No monologue, but interaction!
Feel free to ask, dissent, share!
We’ll have a followup discussion
Big disclaimer
Everything we say from now on is
absolutely second to the fact that...
Big disclaimer
Everything we say from now on is
absolutely second to the fact that...
There is no substitute
for good research!
• Don’t think about publications first
• Do exciting research
Papers are a means to
an end, not a goal
, and the papers will come
• Don’t think about publications first
• Do exciting research
• But do write early!
(e.g., progress reports)
• Helps assess your work
• May eventually lead to a paper
Draft
Papers are a means to
an end, not a goal
, and the papers will come
How to Get My Paper Accepted
at Top SE Conferences
Why bother?
The selection process
Tips and tricks
How to Get My Paper Accepted
at Top SE Conferences
Why bother?
Why bother?
(with ICSE and FSE)
• Low acceptance rates
• One-shot process
• Reviews can be frustrating
• Not ISI indexed
Because it’s worth it
• Improve the impact of your research
• Boost your professional career
(recognition, contacts, collaborations)
• Get useful feedback from peers
(external, independent, usually frank)
Research is as much about ideas
as about communicating them
Embrace rejection
• All authors get rejections
• Rejection is a path to acceptance
• Do not take it personally or blame the reviewers
• Do use the feedback to improve
• Broader, more general results
• More compelling evaluation
• Better motivation and applications
• Stronger theory
• ...
(At least we do...)
Avoid temptation
Don’t give up and settle for
• less readers
• less citations
• less impact
• little (or even negative) impact on your CV
Publishing at “easy” venues will not make
the weaknesses in your work go away...
Papers require a big effort; make it count!
Specific example
blah blah
Specific example
blah blah
A few months later, after taking the
reviewers’ comments into account...
Specific example
blah blah
How to Get My Paper Accepted
at Top SE Conferences
The selection process
How to Get My Paper Accepted
at Top SE Conferences
The selection process
A practical (cynical?) take
The reviewer’s psyche
Highly trained papervore, trained in
science, expert in critical thinking.
Main diet:
•Weak motivations
•Lack of applicability
•Limited contributions
•Unsubstantiated claims
•Obvious solutions
•Weak evaluation
•Inadequate treatment of related work
•Sloppy presentations
ehm... could you
please look for
reasons to accept?
Reviewer
PC Admin
System
Conflicts of Interest
Expertise
Submitted Abstracts
Bidding
1st Phase Papers
1st Phase Reviews
2nd Phase Papers
2nd Phase Reviews
Online Discussion
Program Committee Meeting
Reviewing process
With possible variations
Workload:
approximately one
paper per working day
Submission lifecycle
With possible variations
Submitted
Paper
2 reviews Phase 1
Reviewed
Paper
Rejected
Paper
[No positive reviews]
[Some
positive
review]
Phase 2
Paper
Phase 2
Reviewed
Paper
3rd Review
Rejected
Paper
[Weak/no support]
PC Meeting
Paper
[Strong
Support]
[Negative Decision]Accepted
Paper
Rejected
Paper
[Positive
Decision]
• A – Strong accept
(champion)
• B – Weak accept
(accept, but could reject)
• C – Weak reject
(reject, but could accept)
• D – Strong reject
(over my dead body)
• In addition, expertise
(the paper’s perspective)
PC meeting
•1.5-2 days
•~100 papers discussed
(can be much more)
•~40 people present
•>> 100k air travel miles
•~50% papers accepted
The selection process is perfect
• Limited space
• Limited reviewers’ time/attention
• Limited/varied/wrong reviewers’ expertise
• High selectivity
(i.e., reviewers’ proneness to rejection)
• Human process...
➡Address imperfections to improve your
paper’s chances
far from
The selection process is perfect
• Limited space
• Limited reviewers’ time/attention
• Limited/varied/wrong reviewers’ expertise
• High selectivity
(i.e., reviewers’ proneness to rejection)
• Human process...
➡Address imperfections to improve your
paper’s chances
far from
Limited space
• Focus: explain less, but don’t be superficial
(extra materials can go in a Tech Report)
• Rule of thumb: one paper, one main result
• But avoid LPUs!
Limited space
Limited reviewers’
time/attention
• Write for your reviewers too
• Make paper self contained and accessible
• State your contributions clearly and upfront
(no Agatha Christie’s style!)
• Put extra effort in abstract, introduction,
and conclusions (and captions!)
Limited reviewers’
time/attention
Limited reviewers’
time/attention
• Write for your reviewers too
• Make paper self contained and accessible
• State your contributions clearly and upfront
(no Agatha Christie’s style!)
• Put extra effort in abstract, introduction,
and conclusions (and captions!)
Also addresses limited/varied/
wrong reviewers’ expertise
Reviewers’ proneness
to rejection
• Feed the vulture
• Convey why the problem is important, hard,
and unsolved
• Suitably validate your approach
• Discuss and compare with the state of the art
• Avoid sloppiness in the writing
Reviewers’ proneness
to rejection
How to Get My Paper Accepted
at Top SE Conferences
Tips and tricks
A typical paper structure
• Title, authors
• Abstract
• Introduction
• Paper body
• Related work
• Conclusion
• Acknowledgement
• References
not mandatory
• (Background)
• Approach
• Validation
• (Discussion)
{
• Different styles
• First impression
(for both readers and reviewers)
• Used for bidding
➡Put effort into it!
Abstract
Introduction
(key points)
• What is the problem?
• Why is it interesting/important?
• Why is it hard?
• What's wrong with existing solutions?
• Why is your approach “better”?
• What are the key components of your approach?
• How do your results support your claims?
Introduction
(key points)
• What is the problem?
• Why is it interesting/important?
• Why is it hard?
• What's wrong with existing solutions?
• Why is your approach “better”?
• What are the key components of your approach?
• How do your results support your claims?
All of this in about one page!
Introduction
(writing)
• Tell a story
• Doesn’t have to be the real story
• No “what I did last summer” story
• Just keep it flowing
• One concept per paragraph
• Motivating example?
• Summarize your contributions
(for the reviewers)
Related work
• Location, location, location
• Be explicit on the relation with your
work, don’t just enumerate
• Competing
• Complementary
• Overlapping
• Don’t add PC papers just because
(but do check related work from the PC!)
Related work
(self reference)
• Self plagiarism
• When in doubt, self cite and discuss
• Create a technical report if needed
• Watch out for double submissions!
• Self referentiality
• Are you too ahead?
• Is it an irrelevant or accidental problem?
Approach
• Be precise on
• what you are doing
• how you are doing it
• Do not devote space in proportion to effort
invested
• Discuss limitations honestly and upfront
• Use example(s) throughout to illustrate the
complex parts
(have a single, running example if possible)
• Use section titles, figures, and captions wisely
Validation
(strategies)
• Different strategies for different papers
• First of a kind or well trodden area
• Nature of the contribution
• Options
• Analytical vs empirical
• Comparative (against what?) vs absolute
• Qualitative vs quantitative
• Human studies vs proxies
Validation
(key points)
• Have traceability from claims to validation
• State your research questions
• Describe the experimental protocol
• Be honest in interpreting your results
• List threats to validity (no boilerplate)
• Release code and artifacts
Conclusion
• Do not repeat the introduction or abstract
• Restate
• Can be more concrete
• Discuss future work
(not necessarily yours!)
Overarching advice
• Be self critical
• Write for your audience
• Don’t be sloppy
• Learn the conference/community style
Be self critical
• Let the paper settle
• Role play
• Understanding your own paper is easy
• Pretend you hate it
• Be ruthless in editing/restructuring
• Can be painful
• Use a scrap file
Write for your audience
(in particular, reviewers)
• Help the reader not lose the big picture
• Introduce and conclude each sections
• Avoid digressions and unnecessary details
• Help the non-expert reviewer
• Gradual complexity increase
• Complexity encapsulation and recap
Don’t be sloppy
• Spell check and proof read (no excuses for not doing this!)
• Make citations complete and consistent
• Use reasonable font size and resolution for figures
• Defined all terms exactly once, including acronyms
• Be a bit obsessive
• Make it look good
• Remove widows, orphans, and other formatting issues
• Work on your style
• Keep sentences short
• Use active form but don’t overuse “we”
• Paying attention to verb tenses
• Use help if needed
Learn the conference/
community style
• Read (recent) papers from the conference
• Attend the conference
• Talk to both junior and senior authors
• Solicit feedback on your work
Wrapping up
• There is no formula, but...
(and there are plenty of further readings)
• Don't follow any advice blindly
(especially ours!)
• Find what works for you and feel free to
innovate
• Most importantly...
Wrapping up
• There is no formula, but...
(and there are plenty of further readings)
• Don't follow any advice blindly
(especially ours!)
• Find what works for you and feel free to
innovate
• Most importantly...
Focus on the research and enjoy it!
With much appreciated
input/contributions from
• Abhik Roychoudhury
• Axel van Lamsweerde
• Frank Tip
• Gail Murphy
• James Herbsleb
• Jane Cleland-Huang
• Jeff Kramer
• Jennifer Widom
• Lionel Briand
• Lori Clark
• Martin Robillard
• Matt Dwyer
• Michael Ernst
• Nenad Medvidovic
• Paolo Tonella
• Prem Devanbu
• Sebastian Elbaum
• Tao Xie
• Wes Weimer
• Zhendong Su
And many thanks to all the colleagues whose advise
we collected indirectly, while collaborating, reviewing,
and generally interacting with them (too many to list)

Weitere ähnliche Inhalte

Was ist angesagt?

Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)Dilip Barad
 
Publications in Research Journals
Publications in Research JournalsPublications in Research Journals
Publications in Research JournalsKnihovnaUTB
 
Effective PhD research Progress
Effective PhD research ProgressEffective PhD research Progress
Effective PhD research ProgressOmer Mahfoodh
 
Bio 199 Lecture 3 (Literature Review)
Bio 199 Lecture 3 (Literature Review)Bio 199 Lecture 3 (Literature Review)
Bio 199 Lecture 3 (Literature Review)Marilen Parungao
 
How to Write Research Papers
How to Write Research PapersHow to Write Research Papers
How to Write Research PapersTao Xie
 
Scientific writing anita goel du
Scientific writing   anita goel duScientific writing   anita goel du
Scientific writing anita goel duDr. Anita Goel
 
Introduction to Basics of Python
Introduction to Basics of PythonIntroduction to Basics of Python
Introduction to Basics of PythonElewayte
 
How to Read Academic Papers
How to Read Academic PapersHow to Read Academic Papers
How to Read Academic PapersJia-Bin Huang
 
Systematic literature review technique.pptx
Systematic literature review technique.pptxSystematic literature review technique.pptx
Systematic literature review technique.pptxTANMAY DAS GUPTA
 
How to write a scientific paper for publication
How to write a scientific paper for publicationHow to write a scientific paper for publication
How to write a scientific paper for publicationAnisur Rahman
 
C++ vs python the best ever comparison
C++ vs python the best ever comparison C++ vs python the best ever comparison
C++ vs python the best ever comparison calltutors
 
Big Data Testing: Ensuring MongoDB Data Quality
Big Data Testing: Ensuring MongoDB Data QualityBig Data Testing: Ensuring MongoDB Data Quality
Big Data Testing: Ensuring MongoDB Data QualityRTTS
 
How to Write a Literature Survey for Research Paper/Thesis/Dissertation
How to Write a Literature Survey for Research Paper/Thesis/DissertationHow to Write a Literature Survey for Research Paper/Thesis/Dissertation
How to Write a Literature Survey for Research Paper/Thesis/DissertationLiterature Survey Writing
 
A manual for Ph.D dissertation
A manual for Ph.D dissertationA manual for Ph.D dissertation
A manual for Ph.D dissertationYONG ZHENG
 

Was ist angesagt? (20)

Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)
 
Publications in Research Journals
Publications in Research JournalsPublications in Research Journals
Publications in Research Journals
 
Effective PhD research Progress
Effective PhD research ProgressEffective PhD research Progress
Effective PhD research Progress
 
Bio 199 Lecture 3 (Literature Review)
Bio 199 Lecture 3 (Literature Review)Bio 199 Lecture 3 (Literature Review)
Bio 199 Lecture 3 (Literature Review)
 
How to Write Research Papers
How to Write Research PapersHow to Write Research Papers
How to Write Research Papers
 
Scientific writing anita goel du
Scientific writing   anita goel duScientific writing   anita goel du
Scientific writing anita goel du
 
Introduction to Basics of Python
Introduction to Basics of PythonIntroduction to Basics of Python
Introduction to Basics of Python
 
Publication guidelines
Publication guidelinesPublication guidelines
Publication guidelines
 
Academic Publication Workshop
Academic Publication WorkshopAcademic Publication Workshop
Academic Publication Workshop
 
How to Read Academic Papers
How to Read Academic PapersHow to Read Academic Papers
How to Read Academic Papers
 
Literature review
Literature reviewLiterature review
Literature review
 
Systematic literature review technique.pptx
Systematic literature review technique.pptxSystematic literature review technique.pptx
Systematic literature review technique.pptx
 
Code review
Code reviewCode review
Code review
 
How to write a scientific paper for publication
How to write a scientific paper for publicationHow to write a scientific paper for publication
How to write a scientific paper for publication
 
Research proposal
Research proposalResearch proposal
Research proposal
 
C++ vs python the best ever comparison
C++ vs python the best ever comparison C++ vs python the best ever comparison
C++ vs python the best ever comparison
 
Big Data Testing: Ensuring MongoDB Data Quality
Big Data Testing: Ensuring MongoDB Data QualityBig Data Testing: Ensuring MongoDB Data Quality
Big Data Testing: Ensuring MongoDB Data Quality
 
Python
PythonPython
Python
 
How to Write a Literature Survey for Research Paper/Thesis/Dissertation
How to Write a Literature Survey for Research Paper/Thesis/DissertationHow to Write a Literature Survey for Research Paper/Thesis/Dissertation
How to Write a Literature Survey for Research Paper/Thesis/Dissertation
 
A manual for Ph.D dissertation
A manual for Ph.D dissertationA manual for Ph.D dissertation
A manual for Ph.D dissertation
 

Andere mochten auch

Field Failure Reproduction Using Symbolic Execution and Genetic Programming
Field Failure Reproduction Using Symbolic Execution and Genetic ProgrammingField Failure Reproduction Using Symbolic Execution and Genetic Programming
Field Failure Reproduction Using Symbolic Execution and Genetic ProgrammingAlex Orso
 
fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...
fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...
fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...Mihály Mirk
 
Back-annotation of Simulation Traces with Change-Driven Model Transformations
Back-annotation of Simulation Traces with Change-Driven Model TransformationsBack-annotation of Simulation Traces with Change-Driven Model Transformations
Back-annotation of Simulation Traces with Change-Driven Model TransformationsÁbel Hegedüs
 
VIATRA 3: A Reactive Model Transformation Platform
VIATRA 3: A Reactive Model Transformation PlatformVIATRA 3: A Reactive Model Transformation Platform
VIATRA 3: A Reactive Model Transformation PlatformÁbel Hegedüs
 
Eclipse Neon Democamp Budapest - VIATRA 1.3 release
Eclipse Neon Democamp Budapest - VIATRA 1.3 releaseEclipse Neon Democamp Budapest - VIATRA 1.3 release
Eclipse Neon Democamp Budapest - VIATRA 1.3 releaseÁbel Hegedüs
 
Towards Quality-Aware Development of Big Data Applications with DICE
Towards Quality-Aware Development of Big Data Applications with DICETowards Quality-Aware Development of Big Data Applications with DICE
Towards Quality-Aware Development of Big Data Applications with DICEPooyan Jamshidi
 
Configuration Optimization Tool
Configuration Optimization ToolConfiguration Optimization Tool
Configuration Optimization ToolPooyan Jamshidi
 
Sensitivity Analysis for Building Adaptive Robotic Software
Sensitivity Analysis for Building Adaptive Robotic SoftwareSensitivity Analysis for Building Adaptive Robotic Software
Sensitivity Analysis for Building Adaptive Robotic SoftwarePooyan Jamshidi
 
Autonomic Resource Provisioning for Cloud-Based Software
Autonomic Resource Provisioning for Cloud-Based SoftwareAutonomic Resource Provisioning for Cloud-Based Software
Autonomic Resource Provisioning for Cloud-Based SoftwarePooyan Jamshidi
 
An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...
An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...
An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...Pooyan Jamshidi
 
Transfer Learning for Improving Model Predictions in Robotic Systems
Transfer Learning for Improving Model Predictions  in Robotic SystemsTransfer Learning for Improving Model Predictions  in Robotic Systems
Transfer Learning for Improving Model Predictions in Robotic SystemsPooyan Jamshidi
 
Deep learning-for-pose-estimation-wyang-defense
Deep learning-for-pose-estimation-wyang-defenseDeep learning-for-pose-estimation-wyang-defense
Deep learning-for-pose-estimation-wyang-defenseWei Yang
 
Pose Machine
Pose MachinePose Machine
Pose MachineWei Yang
 
Deformable Part Models are Convolutional Neural Networks
Deformable Part Models are Convolutional Neural NetworksDeformable Part Models are Convolutional Neural Networks
Deformable Part Models are Convolutional Neural NetworksWei Yang
 
Articulated human pose estimation by deep learning
Articulated human pose estimation by deep learningArticulated human pose estimation by deep learning
Articulated human pose estimation by deep learningWei Yang
 
Deep convolutional neural fields for depth estimation from a single image
Deep convolutional neural fields for depth estimation from a single imageDeep convolutional neural fields for depth estimation from a single image
Deep convolutional neural fields for depth estimation from a single imageWei Yang
 
Welcome to Linked Data 0/5 Semtech2011
Welcome to Linked Data 0/5 Semtech2011Welcome to Linked Data 0/5 Semtech2011
Welcome to Linked Data 0/5 Semtech2011Juan Sequeda
 
Consuming Linked Data by Humans - WWW2010
Consuming Linked Data by Humans - WWW2010Consuming Linked Data by Humans - WWW2010
Consuming Linked Data by Humans - WWW2010Juan Sequeda
 
Welcome to Consuming Linked Data tutorial WWW2010
Welcome to Consuming Linked Data tutorial WWW2010Welcome to Consuming Linked Data tutorial WWW2010
Welcome to Consuming Linked Data tutorial WWW2010Juan Sequeda
 
Drupal 7 and Semantic Web Hands-on Tutorial
Drupal 7 and Semantic Web Hands-on TutorialDrupal 7 and Semantic Web Hands-on Tutorial
Drupal 7 and Semantic Web Hands-on TutorialJuan Sequeda
 

Andere mochten auch (20)

Field Failure Reproduction Using Symbolic Execution and Genetic Programming
Field Failure Reproduction Using Symbolic Execution and Genetic ProgrammingField Failure Reproduction Using Symbolic Execution and Genetic Programming
Field Failure Reproduction Using Symbolic Execution and Genetic Programming
 
fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...
fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...
fenyszorason-alapulo-optikai-reszecskeszamlalo-berendezesek-alkalmazasa-a-kor...
 
Back-annotation of Simulation Traces with Change-Driven Model Transformations
Back-annotation of Simulation Traces with Change-Driven Model TransformationsBack-annotation of Simulation Traces with Change-Driven Model Transformations
Back-annotation of Simulation Traces with Change-Driven Model Transformations
 
VIATRA 3: A Reactive Model Transformation Platform
VIATRA 3: A Reactive Model Transformation PlatformVIATRA 3: A Reactive Model Transformation Platform
VIATRA 3: A Reactive Model Transformation Platform
 
Eclipse Neon Democamp Budapest - VIATRA 1.3 release
Eclipse Neon Democamp Budapest - VIATRA 1.3 releaseEclipse Neon Democamp Budapest - VIATRA 1.3 release
Eclipse Neon Democamp Budapest - VIATRA 1.3 release
 
Towards Quality-Aware Development of Big Data Applications with DICE
Towards Quality-Aware Development of Big Data Applications with DICETowards Quality-Aware Development of Big Data Applications with DICE
Towards Quality-Aware Development of Big Data Applications with DICE
 
Configuration Optimization Tool
Configuration Optimization ToolConfiguration Optimization Tool
Configuration Optimization Tool
 
Sensitivity Analysis for Building Adaptive Robotic Software
Sensitivity Analysis for Building Adaptive Robotic SoftwareSensitivity Analysis for Building Adaptive Robotic Software
Sensitivity Analysis for Building Adaptive Robotic Software
 
Autonomic Resource Provisioning for Cloud-Based Software
Autonomic Resource Provisioning for Cloud-Based SoftwareAutonomic Resource Provisioning for Cloud-Based Software
Autonomic Resource Provisioning for Cloud-Based Software
 
An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...
An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...
An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing S...
 
Transfer Learning for Improving Model Predictions in Robotic Systems
Transfer Learning for Improving Model Predictions  in Robotic SystemsTransfer Learning for Improving Model Predictions  in Robotic Systems
Transfer Learning for Improving Model Predictions in Robotic Systems
 
Deep learning-for-pose-estimation-wyang-defense
Deep learning-for-pose-estimation-wyang-defenseDeep learning-for-pose-estimation-wyang-defense
Deep learning-for-pose-estimation-wyang-defense
 
Pose Machine
Pose MachinePose Machine
Pose Machine
 
Deformable Part Models are Convolutional Neural Networks
Deformable Part Models are Convolutional Neural NetworksDeformable Part Models are Convolutional Neural Networks
Deformable Part Models are Convolutional Neural Networks
 
Articulated human pose estimation by deep learning
Articulated human pose estimation by deep learningArticulated human pose estimation by deep learning
Articulated human pose estimation by deep learning
 
Deep convolutional neural fields for depth estimation from a single image
Deep convolutional neural fields for depth estimation from a single imageDeep convolutional neural fields for depth estimation from a single image
Deep convolutional neural fields for depth estimation from a single image
 
Welcome to Linked Data 0/5 Semtech2011
Welcome to Linked Data 0/5 Semtech2011Welcome to Linked Data 0/5 Semtech2011
Welcome to Linked Data 0/5 Semtech2011
 
Consuming Linked Data by Humans - WWW2010
Consuming Linked Data by Humans - WWW2010Consuming Linked Data by Humans - WWW2010
Consuming Linked Data by Humans - WWW2010
 
Welcome to Consuming Linked Data tutorial WWW2010
Welcome to Consuming Linked Data tutorial WWW2010Welcome to Consuming Linked Data tutorial WWW2010
Welcome to Consuming Linked Data tutorial WWW2010
 
Drupal 7 and Semantic Web Hands-on Tutorial
Drupal 7 and Semantic Web Hands-on TutorialDrupal 7 and Semantic Web Hands-on Tutorial
Drupal 7 and Semantic Web Hands-on Tutorial
 

Ähnlich wie How to Get My Paper Accepted at Top Software Engineering Conferences

Workshop -- How to successfully write a scientific paper?
Workshop -- How to successfully write a scientific paper?Workshop -- How to successfully write a scientific paper?
Workshop -- How to successfully write a scientific paper?KnihovnaUTB
 
Journal selection and fast track publication
Journal selection and fast track publicationJournal selection and fast track publication
Journal selection and fast track publicationMuhammad Imran
 
Journal selection and fast track publication
Journal selection and fast track publicationJournal selection and fast track publication
Journal selection and fast track publicationMuhammad Imran
 
Journal selection and fast track publication
Journal selection and fast track publicationJournal selection and fast track publication
Journal selection and fast track publicationMuhammad Imran
 
Surviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation DefenseSurviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation DefenseDoctoralNet Limited
 
Dorothy Faulkner - Thesis & viva student version june2012
Dorothy Faulkner - Thesis & viva student version june2012Dorothy Faulkner - Thesis & viva student version june2012
Dorothy Faulkner - Thesis & viva student version june2012OUmethods
 
Research Methodology and Tips on Better Research
Research Methodology and Tips on Better ResearchResearch Methodology and Tips on Better Research
Research Methodology and Tips on Better ResearchRushdi Shams
 
Manuscript development workshop
Manuscript development workshopManuscript development workshop
Manuscript development workshopSgbed
 
How to write article to be published
How to write article to be publishedHow to write article to be published
How to write article to be publishedAinul Yaqin
 
Literature gap identification gvk sharma-1
Literature gap identification   gvk   sharma-1Literature gap identification   gvk   sharma-1
Literature gap identification gvk sharma-1Pooja Tripathi
 
Getting Published! Exploring strategies, myths and barriers of academic publi...
Getting Published! Exploring strategies, myths and barriers of academic publi...Getting Published! Exploring strategies, myths and barriers of academic publi...
Getting Published! Exploring strategies, myths and barriers of academic publi...Prof Simon Haslett
 
Thesis & viva student version 2013 [compatibility mode]
Thesis & viva student version 2013 [compatibility mode]Thesis & viva student version 2013 [compatibility mode]
Thesis & viva student version 2013 [compatibility mode]VreckaScott
 
edu_managing_time_expectations.ppt
edu_managing_time_expectations.pptedu_managing_time_expectations.ppt
edu_managing_time_expectations.pptShree Shree
 

Ähnlich wie How to Get My Paper Accepted at Top Software Engineering Conferences (20)

Workshop -- How to successfully write a scientific paper?
Workshop -- How to successfully write a scientific paper?Workshop -- How to successfully write a scientific paper?
Workshop -- How to successfully write a scientific paper?
 
Thesis evaluation criteria
Thesis evaluation criteriaThesis evaluation criteria
Thesis evaluation criteria
 
Journal selection and fast track publication
Journal selection and fast track publicationJournal selection and fast track publication
Journal selection and fast track publication
 
Journal selection and fast track publication
Journal selection and fast track publicationJournal selection and fast track publication
Journal selection and fast track publication
 
Journal selection and fast track publication
Journal selection and fast track publicationJournal selection and fast track publication
Journal selection and fast track publication
 
Preparing for your viva
Preparing for your vivaPreparing for your viva
Preparing for your viva
 
How to get published
How to get publishedHow to get published
How to get published
 
Surviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation DefenseSurviving Your Viva or Dissertation Defense
Surviving Your Viva or Dissertation Defense
 
Dorothy Faulkner - Thesis & viva student version june2012
Dorothy Faulkner - Thesis & viva student version june2012Dorothy Faulkner - Thesis & viva student version june2012
Dorothy Faulkner - Thesis & viva student version june2012
 
Research Methodology and Tips on Better Research
Research Methodology and Tips on Better ResearchResearch Methodology and Tips on Better Research
Research Methodology and Tips on Better Research
 
Manuscript development workshop
Manuscript development workshopManuscript development workshop
Manuscript development workshop
 
How to prepare_for_your_viva
How to prepare_for_your_vivaHow to prepare_for_your_viva
How to prepare_for_your_viva
 
How to write article to be published
How to write article to be publishedHow to write article to be published
How to write article to be published
 
How to prepare_for_your_viva
How to prepare_for_your_vivaHow to prepare_for_your_viva
How to prepare_for_your_viva
 
Literature gap identification gvk sharma-1
Literature gap identification   gvk   sharma-1Literature gap identification   gvk   sharma-1
Literature gap identification gvk sharma-1
 
Getting Published! Exploring strategies, myths and barriers of academic publi...
Getting Published! Exploring strategies, myths and barriers of academic publi...Getting Published! Exploring strategies, myths and barriers of academic publi...
Getting Published! Exploring strategies, myths and barriers of academic publi...
 
Thesis & viva student version 2013 [compatibility mode]
Thesis & viva student version 2013 [compatibility mode]Thesis & viva student version 2013 [compatibility mode]
Thesis & viva student version 2013 [compatibility mode]
 
edu_managing_time_expectations.ppt
edu_managing_time_expectations.pptedu_managing_time_expectations.ppt
edu_managing_time_expectations.ppt
 
Paper writing
Paper writingPaper writing
Paper writing
 
Why my paper got rejected
Why my paper got rejectedWhy my paper got rejected
Why my paper got rejected
 

Kürzlich hochgeladen

Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...raviapr7
 
How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17Celine George
 
The Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsThe Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsEugene Lysak
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17Celine George
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxAditiChauhan701637
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational PhilosophyShuvankar Madhu
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxMYDA ANGELICA SUAN
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxraviapr7
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxKatherine Villaluna
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17Celine George
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxKatherine Villaluna
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfMohonDas
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesCeline George
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...CaraSkikne1
 
The Singapore Teaching Practice document
The Singapore Teaching Practice documentThe Singapore Teaching Practice document
The Singapore Teaching Practice documentXsasf Sfdfasd
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxraviapr7
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxDr. Asif Anas
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and stepobaje godwin sunday
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfYu Kanazawa / Osaka University
 

Kürzlich hochgeladen (20)

Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...Patient Counselling. Definition of patient counseling; steps involved in pati...
Patient Counselling. Definition of patient counseling; steps involved in pati...
 
How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17How to Use api.constrains ( ) in Odoo 17
How to Use api.constrains ( ) in Odoo 17
 
The Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George WellsThe Stolen Bacillus by Herbert George Wells
The Stolen Bacillus by Herbert George Wells
 
How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17How to Add a many2many Relational Field in Odoo 17
How to Add a many2many Relational Field in Odoo 17
 
In - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptxIn - Vivo and In - Vitro Correlation.pptx
In - Vivo and In - Vitro Correlation.pptx
 
Philosophy of Education and Educational Philosophy
Philosophy of Education  and Educational PhilosophyPhilosophy of Education  and Educational Philosophy
Philosophy of Education and Educational Philosophy
 
Patterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptxPatterns of Written Texts Across Disciplines.pptx
Patterns of Written Texts Across Disciplines.pptx
 
Prescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptxPrescribed medication order and communication skills.pptx
Prescribed medication order and communication skills.pptx
 
Prelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quizPrelims of Kant get Marx 2.0: a general politics quiz
Prelims of Kant get Marx 2.0: a general politics quiz
 
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptxPractical Research 1: Lesson 8 Writing the Thesis Statement.pptx
Practical Research 1: Lesson 8 Writing the Thesis Statement.pptx
 
How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17How to Make a Field read-only in Odoo 17
How to Make a Field read-only in Odoo 17
 
Practical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptxPractical Research 1 Lesson 9 Scope and delimitation.pptx
Practical Research 1 Lesson 9 Scope and delimitation.pptx
 
Diploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdfDiploma in Nursing Admission Test Question Solution 2023.pdf
Diploma in Nursing Admission Test Question Solution 2023.pdf
 
How to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 SalesHow to Manage Cross-Selling in Odoo 17 Sales
How to Manage Cross-Selling in Odoo 17 Sales
 
5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...5 charts on South Africa as a source country for international student recrui...
5 charts on South Africa as a source country for international student recrui...
 
The Singapore Teaching Practice document
The Singapore Teaching Practice documentThe Singapore Teaching Practice document
The Singapore Teaching Practice document
 
Education and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptxEducation and training program in the hospital APR.pptx
Education and training program in the hospital APR.pptx
 
Ultra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptxUltra structure and life cycle of Plasmodium.pptx
Ultra structure and life cycle of Plasmodium.pptx
 
General views of Histopathology and step
General views of Histopathology and stepGeneral views of Histopathology and step
General views of Histopathology and step
 
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdfP4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
P4C x ELT = P4ELT: Its Theoretical Background (Kanazawa, 2024 March).pdf
 

How to Get My Paper Accepted at Top Software Engineering Conferences

  • 1. How Can I Get My Paper Accepted at a Top SE Conference? Alessandro (Alex) Orso Georgia Institute of Technology, USA http://www.cc.gatech.edu/~orso/ Sebastian Uchitel University of Buenos Aires,AR Imperial College London, UK http://lafhis.dc.uba.ar/~suchitel/
  • 2. Before we start... • We asked for input from colleagues in the community...
  • 3. Before we start... • We asked for input from colleagues in the community... • “OMG, this is such a difficult task!” • “There is no recipe” • ...
  • 4. Before we start... • We asked for input from colleagues in the community... • “OMG, this is such a difficult task!” • “There is no recipe” • ... • But there are some general, shared principles
  • 5. Before we start... • We asked for input from colleagues in the community... • “OMG, this is such a difficult task!” • “There is no recipe” • ... • But there are some general, shared principles ➡ Our goal is not to give you a recipe, but to share (our and others’) principles and experience accumulated as • researchers, writers, and advisors • associate editors of TSE and TOSEM • conference program chairs • program committee members
  • 6. Before we start... • We asked for input from colleagues in the community... • “OMG, this is such a difficult task!” • “There is no recipe” • ... • But there are some general, shared principles ➡ Our goal is not to give you a recipe, but to share (our and others’) principles and experience accumulated as • researchers, writers, and advisors • associate editors of TSE and TOSEM • conference program chairs • program committee members No monologue, but interaction! Feel free to ask, dissent, share! We’ll have a followup discussion
  • 7. Big disclaimer Everything we say from now on is absolutely second to the fact that...
  • 8. Big disclaimer Everything we say from now on is absolutely second to the fact that... There is no substitute for good research!
  • 9. • Don’t think about publications first • Do exciting research Papers are a means to an end, not a goal , and the papers will come
  • 10. • Don’t think about publications first • Do exciting research • But do write early! (e.g., progress reports) • Helps assess your work • May eventually lead to a paper Draft Papers are a means to an end, not a goal , and the papers will come
  • 11. How to Get My Paper Accepted at Top SE Conferences Why bother? The selection process Tips and tricks
  • 12. How to Get My Paper Accepted at Top SE Conferences Why bother?
  • 13. Why bother? (with ICSE and FSE) • Low acceptance rates • One-shot process • Reviews can be frustrating • Not ISI indexed
  • 14. Because it’s worth it • Improve the impact of your research • Boost your professional career (recognition, contacts, collaborations) • Get useful feedback from peers (external, independent, usually frank) Research is as much about ideas as about communicating them
  • 15. Embrace rejection • All authors get rejections • Rejection is a path to acceptance • Do not take it personally or blame the reviewers • Do use the feedback to improve • Broader, more general results • More compelling evaluation • Better motivation and applications • Stronger theory • ... (At least we do...)
  • 16. Avoid temptation Don’t give up and settle for • less readers • less citations • less impact • little (or even negative) impact on your CV Publishing at “easy” venues will not make the weaknesses in your work go away... Papers require a big effort; make it count!
  • 18. Specific example blah blah A few months later, after taking the reviewers’ comments into account...
  • 20. How to Get My Paper Accepted at Top SE Conferences The selection process
  • 21. How to Get My Paper Accepted at Top SE Conferences The selection process A practical (cynical?) take
  • 22. The reviewer’s psyche Highly trained papervore, trained in science, expert in critical thinking. Main diet: •Weak motivations •Lack of applicability •Limited contributions •Unsubstantiated claims •Obvious solutions •Weak evaluation •Inadequate treatment of related work •Sloppy presentations ehm... could you please look for reasons to accept?
  • 23. Reviewer PC Admin System Conflicts of Interest Expertise Submitted Abstracts Bidding 1st Phase Papers 1st Phase Reviews 2nd Phase Papers 2nd Phase Reviews Online Discussion Program Committee Meeting Reviewing process With possible variations Workload: approximately one paper per working day
  • 24. Submission lifecycle With possible variations Submitted Paper 2 reviews Phase 1 Reviewed Paper Rejected Paper [No positive reviews] [Some positive review] Phase 2 Paper Phase 2 Reviewed Paper 3rd Review Rejected Paper [Weak/no support] PC Meeting Paper [Strong Support] [Negative Decision]Accepted Paper Rejected Paper [Positive Decision] • A – Strong accept (champion) • B – Weak accept (accept, but could reject) • C – Weak reject (reject, but could accept) • D – Strong reject (over my dead body) • In addition, expertise (the paper’s perspective)
  • 25. PC meeting •1.5-2 days •~100 papers discussed (can be much more) •~40 people present •>> 100k air travel miles •~50% papers accepted
  • 26. The selection process is perfect • Limited space • Limited reviewers’ time/attention • Limited/varied/wrong reviewers’ expertise • High selectivity (i.e., reviewers’ proneness to rejection) • Human process... ➡Address imperfections to improve your paper’s chances far from
  • 27. The selection process is perfect • Limited space • Limited reviewers’ time/attention • Limited/varied/wrong reviewers’ expertise • High selectivity (i.e., reviewers’ proneness to rejection) • Human process... ➡Address imperfections to improve your paper’s chances far from
  • 28. Limited space • Focus: explain less, but don’t be superficial (extra materials can go in a Tech Report) • Rule of thumb: one paper, one main result • But avoid LPUs! Limited space
  • 29. Limited reviewers’ time/attention • Write for your reviewers too • Make paper self contained and accessible • State your contributions clearly and upfront (no Agatha Christie’s style!) • Put extra effort in abstract, introduction, and conclusions (and captions!) Limited reviewers’ time/attention
  • 30. Limited reviewers’ time/attention • Write for your reviewers too • Make paper self contained and accessible • State your contributions clearly and upfront (no Agatha Christie’s style!) • Put extra effort in abstract, introduction, and conclusions (and captions!) Also addresses limited/varied/ wrong reviewers’ expertise
  • 31. Reviewers’ proneness to rejection • Feed the vulture • Convey why the problem is important, hard, and unsolved • Suitably validate your approach • Discuss and compare with the state of the art • Avoid sloppiness in the writing Reviewers’ proneness to rejection
  • 32. How to Get My Paper Accepted at Top SE Conferences Tips and tricks
  • 33. A typical paper structure • Title, authors • Abstract • Introduction • Paper body • Related work • Conclusion • Acknowledgement • References not mandatory • (Background) • Approach • Validation • (Discussion) {
  • 34. • Different styles • First impression (for both readers and reviewers) • Used for bidding ➡Put effort into it! Abstract
  • 35. Introduction (key points) • What is the problem? • Why is it interesting/important? • Why is it hard? • What's wrong with existing solutions? • Why is your approach “better”? • What are the key components of your approach? • How do your results support your claims?
  • 36. Introduction (key points) • What is the problem? • Why is it interesting/important? • Why is it hard? • What's wrong with existing solutions? • Why is your approach “better”? • What are the key components of your approach? • How do your results support your claims? All of this in about one page!
  • 37. Introduction (writing) • Tell a story • Doesn’t have to be the real story • No “what I did last summer” story • Just keep it flowing • One concept per paragraph • Motivating example? • Summarize your contributions (for the reviewers)
  • 38. Related work • Location, location, location • Be explicit on the relation with your work, don’t just enumerate • Competing • Complementary • Overlapping • Don’t add PC papers just because (but do check related work from the PC!)
  • 39. Related work (self reference) • Self plagiarism • When in doubt, self cite and discuss • Create a technical report if needed • Watch out for double submissions! • Self referentiality • Are you too ahead? • Is it an irrelevant or accidental problem?
  • 40. Approach • Be precise on • what you are doing • how you are doing it • Do not devote space in proportion to effort invested • Discuss limitations honestly and upfront • Use example(s) throughout to illustrate the complex parts (have a single, running example if possible) • Use section titles, figures, and captions wisely
  • 41. Validation (strategies) • Different strategies for different papers • First of a kind or well trodden area • Nature of the contribution • Options • Analytical vs empirical • Comparative (against what?) vs absolute • Qualitative vs quantitative • Human studies vs proxies
  • 42. Validation (key points) • Have traceability from claims to validation • State your research questions • Describe the experimental protocol • Be honest in interpreting your results • List threats to validity (no boilerplate) • Release code and artifacts
  • 43. Conclusion • Do not repeat the introduction or abstract • Restate • Can be more concrete • Discuss future work (not necessarily yours!)
  • 44. Overarching advice • Be self critical • Write for your audience • Don’t be sloppy • Learn the conference/community style
  • 45. Be self critical • Let the paper settle • Role play • Understanding your own paper is easy • Pretend you hate it • Be ruthless in editing/restructuring • Can be painful • Use a scrap file
  • 46. Write for your audience (in particular, reviewers) • Help the reader not lose the big picture • Introduce and conclude each sections • Avoid digressions and unnecessary details • Help the non-expert reviewer • Gradual complexity increase • Complexity encapsulation and recap
  • 47. Don’t be sloppy • Spell check and proof read (no excuses for not doing this!) • Make citations complete and consistent • Use reasonable font size and resolution for figures • Defined all terms exactly once, including acronyms • Be a bit obsessive • Make it look good • Remove widows, orphans, and other formatting issues • Work on your style • Keep sentences short • Use active form but don’t overuse “we” • Paying attention to verb tenses • Use help if needed
  • 48. Learn the conference/ community style • Read (recent) papers from the conference • Attend the conference • Talk to both junior and senior authors • Solicit feedback on your work
  • 49. Wrapping up • There is no formula, but... (and there are plenty of further readings) • Don't follow any advice blindly (especially ours!) • Find what works for you and feel free to innovate • Most importantly...
  • 50. Wrapping up • There is no formula, but... (and there are plenty of further readings) • Don't follow any advice blindly (especially ours!) • Find what works for you and feel free to innovate • Most importantly... Focus on the research and enjoy it!
  • 51. With much appreciated input/contributions from • Abhik Roychoudhury • Axel van Lamsweerde • Frank Tip • Gail Murphy • James Herbsleb • Jane Cleland-Huang • Jeff Kramer • Jennifer Widom • Lionel Briand • Lori Clark • Martin Robillard • Matt Dwyer • Michael Ernst • Nenad Medvidovic • Paolo Tonella • Prem Devanbu • Sebastian Elbaum • Tao Xie • Wes Weimer • Zhendong Su And many thanks to all the colleagues whose advise we collected indirectly, while collaborating, reviewing, and generally interacting with them (too many to list)