SlideShare ist ein Scribd-Unternehmen logo
1 von 61
So you
want to
be a GOV
UXer…
A primer for anyone interested in doing user experience work for the US Federal Government.
Jeffrey Ryan Pass | @jeffpass | #UXPA2021 | Baltimore, MD, 8.31.21 Harold Lang photo of Pentagon construction, ~1941.
A note on the design theme for this presentation
To work in the Public Sector is to perform public work.
Whether your call it User UX, CX (as Customer
Experience), or CX (as Citizen Experience), the work of
GOV UXers it at the vanguard of digital pubic work.
Given this notion and the topic of this presentation, most
imagery and illustrations used depict public work
projects and artworks.
Most of these were commissioned and funded by the
New Deal ear Works Progress Administration (WPA) and
date back to the 1930s and 1940s.
Selections were made to reflect maximum diversity and
inclusion given the era and limited image options.
The Works Progress Administration logo (1936).
The presentation will cover:
● Some GOV UX stats that might surprise you
● A brief history of Federal rules/regs affecting UX
● Agencies, actors, and influencers to know
● Federal web culture fundamentals
● Usability testing rules and regs
● Citizen engagement goals and techniques
● Resources and communities for GOV UXers
● Appendices including (1) Colophon, (2) References & Citations (3) Image Citations
But first some quick background on your presenter; a.k.a., why this guy?
Jeffrey Ryan Pass
In 23+ years on the front lines of US Federal GOV UX I’ve:
● Worked for dozens of federal agencies on hundreds
of projects, including some of the highest profile
government sites, applications, and initiatives.
● Been involved in key research, policies, organizations,
and teams that have shaped US digital government.
● Supported and organized DMV-area (Maryland,
District of Columbia, and Virginia) UX events and
communities of practice (COPs), as well as regional,
national, and international industry conferences.
I’ve even taught fundamentals of UX and IA (distinct
courses) using the LEGO®SERIOUS PLAY®methodology.
LEGO® self portrait, 2016.
Feel free to contact me:
Twitter: @jeffpass
LinkedIn: jeffreyryanpass
Some GOV UX stats that might surprise you
Carol Highsmith photo of Anton Refregier WPA Mural, 2012.
How many is too many?
In 2011 there were almost 2,000 separate Federal Government websites
prompting Macom Phillips, then director of the Office of Digital Strategy under
President Barack Obama, to create the campaign TooManyWebsites.gov.
● The effort (part of the Obama Federal Digital Strategy) managed to produce an
inventory of all government sites and to reduce the number of sites
significantly.
● The effort was abandoned by the next administration and has not yet been
picked up by the current administration.
● There currently is not a published listing of all .gov, .mil, and related U.S.
Government domains managed by federal executive branch agencies.
Federal website traffic
APIs (application programming interfaces) from
NOAA, USPS, and other agencies power weather
reports, package tracking, and countless other tools
and applications around the world accounting for
immeasurable traffic. Additionally...
● 14B sessions and 38B page views of federal
websites in 2019 (GSA, 2021)
● In 2021 thats grown to 5B+ visits every 90 days
(Analytics.gov, 2021)
● USPS and IRS web domains typically appear
among the top 100 US-based websites (by
traffic), and sometimes in the top 50 (Alexa)
● During COVID, NIH.gov has remained in the top
50 sites (Alexa)
Analytics.USA.gov (1 hour ago).
Federal government workforce
● 4.3 million federal gov employees (Pew, 2021)
● ~10 million government workers if you include
civil servants, postal workers, active military,
contractors, and grantees. (Brookings, 2020)
● Contractors typically make up ~50% of
government workers (Brookings, 2020)
● There are more than 10,000 federal jobs
currently open (USAJobs.gov)
● Including 175 tagged with “user experience”
as of this morning (USAJobs.gov)
● There are easily as many federal contract jobs
currently open
Nicolai Cikovski WPA mural, “Irrigration”, photographed 2011.
A brief history of Federal rules/regs affecting UX
Carol Highsmith photo of Mitchell Jamieson WPA Mural, 2011.
Rules, regs, and limitations affecting UX work (1 of 3)
The following provides a high level listing of notable milestones, rules, and
regulations that directly affect day-to-day life as a GOV Uxer.
1968: Architectural Barriers Act (ABA) of 1968
1973: Rehabilitation Act of 1973 (Rehab Act)
1990: Americans with Disabilities Act
1991: Americans with Disabilities Act Accessibility Guidelines (ADAAG)
1996: Telecommunications Act of 1996
1998: Telecommunications Act Accessibility Guidelines
2000: Section 508 Standards
2002: E-Government Act of 2002
2004: The Research-Based Web Design & Usability Guidelines
2005: Report of the Citizen Services Levels Interagency Committee CSLIC
2006: The Research-Based Web Design & Usability Guidelines (Update)
2008: - Federal WEb Managers Council White Paper: Putting Citizens First: Transforming
- Online Government
- Web Content Accessibility Guidelines (WCAG) 2.0
Rules, regs, and limitations affecting UX work (2 of 3)
2009: Open Government Directive
2010: - Social Media, Web-Based Interactive Technologies, and the Paperwork Reduction Act
- Plain Writing Act of 2010
- OMB M-10-22, Guidance for Online Use of Web Measurement and Customization
Technologies
- Final Rule – 41 CFR Part 102-173 Internet Gov Domain
- Twenty-First Century Communications and Video Accessibility Act
2011: OMB M-11-26 – Fast-Track Process for Collecting Service Delivery Feedback Under the
Paperwork Reduction Act
2012: - 2012 Digital Government Strategy (Federal Digital Strategy)
- Executive Order 13571, Streamlining Service Delivery and Improving Customer Service
- Executive Order 13576, Delivering an Efficient, Effective, and Accountable Government
2014: US Digital Services Playbook
2015: - United States Web Design System
- Policies for DotGov Domain Issuance for Federal Agency Public Websites
Rules, regs, and limitations affecting UX work (3 of 3)
2015: Executive Memorandum M-15-13, Policy to Require Secure Connections across Federal
Websites and Web Services (The HTTPS-Only Standard)
2016: - OMB M-17-06, Policies for Federal Agency Public Websites and Digital Services
- OMB Circular A-130, Managing Information as a Strategic Resource
- Executive Memorandum M-16-21, Federal Source Code Policy (FSCP)
2017: - Section 508 of the Rehabilitation Act and Section 255 of the Communications Act
- (updated)
- Executive Memorandum M-13-13, Open Data Policy-Managing Information as an Asset
2018: - Connected Government Act
- 21st Century Integrated Digital Experience Act (IDEA)
2020: Executive Memorandum M-21-07, Completing the Transition to Internet Protocol Version 6
(IPv6)
Agencies, actors, and influencers to know
Carol Highsmith photo of Edgar Britton WPA Mural, 2011.
U.S. Government:
● 18F (gov digital service bureau, part of GSA) - https://18f.gsa.gov/
● Access Board (disability equality) - https://www.access-board.gov/
● Federal Chief Information Officers (CIOs) Council (CIO Council + CIO.gov) -
https://www.cio.gov/
● Federal Web Managers Council - https://digital.gov/resources/federal-web-
council/
● United States Digital Service (USDS) (part of the Executive Office of the
President) - https://www.usds.gov/
Foreign counterpart and non-governmental organizations:
● Australian Digital Transformation Agency - https://www.dta.gov.au/
● Gov.UK - https://www.gov.uk/
● UK Government Service Manual - https://www.gov.uk/service-manual
● New Zealand Digital Government - https://www.digital.govt.nz/
● Netherlands Digital Government - https://www.nldigitalgovernment.nl/
● Netherlands Digital Government Agenda -
https://www.nldigitalgovernment.nl/digital-government-agenda/
● OECD Digital Government (Office of Economic Cooperation and Development) -
https://www.oecd.org/gov/digital-government/
● OECD Digital Government Toolkit - https://www.oecd.org/governance/digital-
government/toolkit/
Federal web culture fundamentals
Carol Highsmith photo of Clarkson S. Fisher Building WPA Mural, 2010.
As a new GOV UXer you
may feel like you want to
REDESIGN
EVERYTHING!
And that’s the right idea, but…
You will encounter frictions:
● The value/importance of UX is not
universally recognized, and…
● Even when it is, it is not always
prioritized or funded, plus…
● UX and design are often brought in
late, sometimes as an afterthought
Conrad Albrizo WPA fresco of Louisiana industries, ~1939.
Often UXers are Firefighters:
● We are often brought in after the
fact to fix problems
● Or inherit antiquated designs,
architectures, and content strategies
that we’re expected to maintain
while improving while redesigning
● We’re often called upon to provide
front-end solutions to back-end
problems
1938 Ernest Fiene WPA mural of firefighters fighting a blaze.
Frontend
solutions for
backend
problems...
Image: HealthCare.gov Waiting Room, October, 2013.
Federal government agencies are all different and...
● Are often decentralized; agencies and operating divisions (op divs) have their
own culture, rules, regs
● Tend to organize (and share) information based or organizational structure or
internal ‘domain’ knowledge
● Struggle with the classic IT vs. communications vs. marketing dilemma with
regard to digital domain ownership and management
● Have longer project runways and implementation and maintenance timelines
Plus, they have a tendency to pay lip service to Agile, SCRUM, and other
methodologies (as well as UX best practices) that are frequently diluted or perverted
when applied within a government agency bureaucracy.
(But really, isn’t that everywhere?)
And agencies are subject to...
● Both federal and agency-specific regulations that are often more vigorously
monitored and enforced than in the private sector
● Continuing resolutions (CR) and other budget uncertainties (including
sequestration and shut-downs) not present in the private sector
○ In all but 4 of the last 40 years, Congress has passed CRs to keep agencies running between
budgets
● Politicization of agency budgets, scope, operations, etc.
● Federal and agency inertia and fiduciary obligations to the public that result in
an aversion to risk and that can make innovation difficult
But they are also committed
Still, they are committed to their missions and the public
As UX (and Citizen Experience) become less of an afterthought, the roadblocks to
doing UX work have become fewer and farther in between.
● Many agencies (and all Cabinet-level agencies) have embraced the value of UX
and usability testing and have reduced impediments to UXers.
● PRA exceptions better understood and PRA Clearance Officers are increasingly
savvy about helping facilitate usability studies.
● Many agencies have their own usability testing labs, that are often available to
other federal agencies, though COVID has temporarily (hopefully) shuttered
many of these labs.
So, all that said, if you are interested in positively impacting the
lives of Americans, government work is an...
AMAZING
OPPORTUNITY
...to work with some great people and make a real difference!
Usability testing rules and regulations
Carol Highsmith photo of Anton Refregier WPA Mural, 2012.
The Paperwork Reduction Act
As it relates to usability studies
The Paperwork Reduction Act (PRA) of 1995
● Established to reduce the amount of paperwork burden imposed on citizens and
private businesses
● Requires U.S. federal government agencies to obtain Office of Management and
Budget (OMB) approval before collecting most types of information from the
public
● Includes two processes for obtaining clearance through OMB:
○ Traditional Clearance (6-9 months)
○ Fast-Track Clearance (~5-days per request, but qualifying takes 6+ months)
The PRA Applies
● To any data collection vehicle involving 10 or more participants and utilizing
standardized questions
● To any type of respondent (individuals, organizations, states, etc.)
● Regardless of form or format (interview, survey, etc.)
● Regardless of collection method (in-person, telephonic, electronic)
But PRA does not apply to:
● Direct observation and non-standardized conversation (5 CFR 1320.3(h)3)
● Direct tests of knowledge or aptitude (5 CFR 1320.3(h)7)
● Federal employees (and some agencies extend this to their contractors)
Federal Agencies and PRA
● Agencies are required to have a PRA Clearance Officer
○ This role is often combined with other compliance roles (e.g., the FOIA Liaison)
○ If you are at an Operational Division (Op Div), Commission, or sub-agency organization, your PRA
Clearance Officer may sit at the parent agency-level
● Never start work on a Traditional Clearance request before confirming whether
the agency is Fast-Track approved
● If your agency does not have Fast-Track, work with your PRA Clearance Officer to
pursue it
○ The level of effort (LOE) is comparable to securing a Traditional Clearance, but once attained,
individual clearances can be achieved quickly and with a low LOE
PRA Traditional Clearance
● Used for individual collection requests
● Typically takes 6-9 months, including:
○ 60-day* and 30-day** public comment periods
○ 60-day OMB response periods following each public comment period
Four step process:
1. Prepare/publish requirements in the Federal Register*
2. Prepare Information Collection Request (ICR) package
3. Publish ICR and Supporting Statement to in the Federal Register**
4. Submit proposed collection to OMB and publish in Federal Register**
Followed by individual request approval/rejection
PRA Fast-Track Clearance: Eligibility
Only available for a subset of collection activities:
● Focus groups
● One-time panels and discussion groups
● Usability studies
● Post transaction surveys, and online surveys
To be Fast-Track eligible, collections must:
● Be voluntary
● Involve no significant burden to respondents
● Not require extensive statistical analysis
● Not involve public dissemination of results
PRA Fast-Track Clearance: Generic Clearance
Fast-Track Clearance is a two-part process:
● Securing Generic Clearance
● Securing clearance for individual Information Collection Requests (ICRs)
There are 7 steps to securing generic Fast-Track clearance:
1. Prepare a generic draft ICR
2. Review/revision/approval by PRA Clearance Officer
3. Submit 30-day Federal Register Notice
4. Finalize draft, review/revision/approval by PRA Clearance Officer
5. PRA Clearance Officer sends ICR to OMB
6. OMB review/revision/approval
7. OMB issues a Notification of Action (NOA: approve, disapprove, withdrawal)
PRA Fast-Track Clearance: ICR Clearance
Once Generic Clearance is secured, individual ICR clearance request can be
submitted.
There are 5 steps to securing each individual ICR clearance:
1. Prepare ICR using short form
2. Review/revision/approval by PRA Clearance Officer
3. PRA Clearance Officer sends ICR to OMB
4. OMB has 5 days to review the ICR
5. OMB issues an NOA (approve, disapprove, withdrawal)
(OMB failure to review within 5 days = automatic approval)
PRA Clearance: Statutory Requirements
Once Traditional or Fast-Track PRA
clearance has been granted, the
collection must include/display the
following clearance documentation:
● OMB control number
● Expiration date
● Expected burden
● Public protection clause
Recruiting & Incentives
For Usability Studies
Discussing Recruiting & Incentives
Because of various federal rules and best practices, we must be careful how we discuss
recruiting and incentives (especially incentives).
● Incentives: we use the words “incentive” and “stipend” to describe compensation for
participation in a usability test, focus group, or other, similar activity
● We do not use words/phrases like: “pay,” “payment,” “reimburse,” or “compensate”
● Reasoning: recruiting incentives do not require W9s or formal invoicing in the way
that payments (and similar compensation-related transactions) do; therefore it is
important to avoid such language.
Third-Party Partners for Recruiting
More often than not, federal agencies and their primary contractors do not undertake
recruiting activities or the management of recruiting for usability studies and related
activities due to PII concerns related to recruiting, data collection, and data
maintenance. Instead, they use third-party partners to perform recruiting activities,
including:
● Developing and maintaining recruiting databases
● Recruiting, vetting, and scheduling test participants
● Providing incentives to participants after test completion
Handling Incentives
For federal agencies:
● Developing and maintaining recruiting databases
● Recruiting, vetting, and scheduling test participants
● Providing incentives to participants after test completion
For contracting organizations and contractors:
● Ability and budget must be stipulated in the client contract, or...
● Expressly allowed as an acceptable use for ODC (Other Direct Costs) budgets
● Must follow all contractual and IRS requirements regarding recording and
disclosure, including the possible issuance of W9s
When You Don’t Need a Third-Party Partner
There are several exceptions to the third-party partner recruiting rule:
● When ‘anonymous’ recruiting can be performed via client social media
○ E.g., inviting Facebook followers to anonymously opt-in to an unmoderated, online usability
activity like a card sort or tree test
● When the client has a listing of ‘opted-in’ participants
○ E.g., client site visitors that volunteered to participate in usability studies when completing a
voice-of-the-consumer survey
○ E.g., federal employees of the client agency (no incentives may be provided)
● When you are performing “guerrilla testing”
○ E.g., when performing ‘impromptu’ testing at a client site, conference, mall, etc.
Citizen engagement goals and techniques
Carol Highsmith photo of Cohen Building WPA Mural, 2008.
Citizen engagement is required
The Obama White House’s Federal Digital
Strategy required that all Federal
Government websites be “customer-centric”
and that they “offer easy paths for feedback
to ensure we continually improve service
delivery.”
Therein lies one of the best mechanisms for
engaging citizens in UX work.
Obama Administration Federal Digital Strategy; quotes and cover (2012)
Engage/recruit where users are
● Many federal digital customer feedback
surveys include an opt-in for respondents
to allow that agency to contact them by
way of follow-up and to engage them in
surveys, user research, etc.
● Most agencies have a social media
presence, often including accounts on
numerous platforms and frequently for
top-level departments and op divs within
the agency.
● Numerous agencies have blog or
syndicated communications.
All are fertile ground for recruiting.
Obama Administration Federal Digital Strategy; quotes and cover (2012)
Opt-in recruiting
Email list blasts, social media posts, direct
responses to customer feedback, and similar
methods can be used to allow would-be
participants to opt into studies.
Respondents are typically directed to a recruiting
screener/survey that:
● Collect the minimum required PII for
recruitment
● Use general demographic questions to allow
for data segmentation without unnecessary PII
collection
WPA study group registration poster (1936-1941)
Guerrilla Usability Testing
Many agencies offer services at locations
around the country providing an excellent
opportunity to engage users where they
transact in-person.
● When the client has a listing of ‘opted-in’
participants
● When you are performing “guerrilla
testing”
○ E.g., when performing ‘impromptu’ testing at a
client site, conference, mall, etc.
WPA Federal Writers’ Project book cover (1937)
Resources and communities for GOV UXers
Carol Highsmith photo of Cohen Building WPA Mural, 2008.
● Overarching Policies
● Accessibility / Section 508
● Analytics
● Coordination During
Incidents of National
Significance
● Copyright
● Customer Experience
● Design
● Domains
● Freedom of Information Act (FOIA)
● Governance
● Information Quality
● Mandatory Content
● Mobile
● Multilingual Websites
● Open Govt./Data/Content
● Paperwork Reduction
● Performance Measurement and
Reporting
● Plain Writing
● Privacy and Identity
Management
● Prohibition on Advertising
● Records Management
● Search
● Security
● Technology Standards
● Third-Party Services/
● Social Media
Digital.gov requirements for federal web & digital services
The GSA (U.S. General Services Administration) website Digital.gov (https://digital.gov/)
is an invaluable resource. It contains THE requirements checklist for Federal Websites
and Digital Services (which is updated frequently):
https://digital.gov/resources/checklist-of-requirements-for-federal-digital-services/.
Curated listings of resources are organized by topic, including:
● 21st Century IDEA
● Accessibility
● Agile
● Content
● Content Strategy
● Crowdsourcing
● Customer Experience
● Data
● Design
● Governance
● Metrics
● Mobile
● Multilingual
● Open Data
● Performance
● Plain Language
● Policies & Regulations
● Privacy
● Product Management
● Project Management
● Research
● Security
● Social Media
● Strategy
● Training
● Usability
● User Experience
● User Research
● Web Design Systems
● And much more!
Digital.gov guides and resources
The GSA is also one of the best resources for information, guides, resources, tools,
and services: https://digital.gov/resources/. Curated listings of resources are
organized by topic, including:
18F resources
The GSA’s 18F is another important collection of resources and products:
https://product-guide.18f.gov/.
Product management in government:
● Guide to product management
● The importance of gov product management
General:
● 18F / TTS Handbook
● Getting started at TTS: Your first 90 days
● 18F Project Catalogue
● 18F Project Resources Library
● 18F Methods
● Checklist of requirements for federal
government websites
● USDS Playbook
Guides:
● Project Start Guide
● 18F De-risking Government Technology
Guide
● 18F User Experience Design Guide
● 18F Content Guide
● TTS Engineering Guide Front-end practices
● 18F Analytics standards
● 18F Accessibility Guide
● Agile Principles and 18F Practices
● Before You Ship: TTS guide to launching
software
Government COPs (communities of practice)
The Federal Government has many digital-focused COPs listed at
https://digital.gov/communities/ and including:
● Agile/Lean
● APIs
● Artificial Intelligence (AI)
● Blockchain
● Challenge & Prize
● Cloud and Infrastructure
● Crowsourcing & Citizen
Science
● Customer Experience
● DevOps
● Federal Communicators
● Federal Leadership and
Professional Development
● Federal Technology
Investment Management
● Government Contact Center
Council (G3C)
● Innovation Adoption
● IT Accessibility/Section 508
● Mobile
● Multilingual
● Open Data
● Open Source
● OpenGov
● Plain Language
● Results-Oriented
Accountability for Grants
● Robotic Process
Automation (RPA)
● Social Media
● U.S. Web Design System
● User Experience
● Video Production Pros
● VR & AR
● Web Analytics and
Optimization
● Web Managers
Important Federal Government sites/resources (1 of 2)
While some of these show up in the Digital.gov Accessibility Resources page, each is
worthy of top-level placement in any listing of GOV UXer resources:
● Accessibility.gov (508/accessibility) - https://accessibility.gov/
● Analytics.USA.gov - https://analytics.usa.gov/
● API.Data.gov (API management service for agencies) - https://api.data.gov/about/
● Benefits.gov (state and federal employee benefits) - https://www.benefits.gov/
● CIO.gov (Federal Chief Information Officers forum) - https://cio.gov/
● Data.gov (gov open data) - https://www.data.gov/
● Digital Analytics Program (DAP) - https://digital.gov/guides/dap/
● Digital Government: Building a 21st Century Digital Government (Obama Whitehouse Archives) -
https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital-government/ digital-
government.html
● Digital.gov Events - https://digital.gov/events/
● Digital Services Playbook (United States Digital Service) - https://playbook.cio.gov/
● Federal Communities of Practice (Fed COPs) - https://digital.gov/communities/
● Federal Register (the gov daily journal) - https://www.federalregister.gov/
● Federal Tools and Services - https://digital.gov/services/
● General Services Administration (GSA) - https://www.gsa.gov/
Important Federal Government sites/resources (2 of 2)
● IT Dashboard (Federal IT Investment performance) - https://www.itdashboard.gov/
● Office of E-Government & Information Technology -
https://www.whitehouse.gov/omb/management/egov/
● Office of Personnel Management (OPM) - https://www.opm.gov/
● Official U.S. Executive Branch Websites (Library of Congress-managed listing) -
https://www.loc.gov/rr/news/fedgov.html
● Research-Based Web Design & Usability Guidelines (Usability.gov, HHS, and GSA sponsored) -
https://www.usability.gov/sites/default/files/documents/guidelines_book.pdf
● Plain Language.gov (plain writing) - https://www.plainlanguage.gov/
● Regulations.gov (review and comment on regulations) - https://www.regulations.gov/
● Section508.gov (508/accessibility) - https://www.section508.gov/
● TechFAR Hub (digital service acquisition best practices) - https://techfarhub.cio.gov/
● Usability.gov - https://www.usability.gov/
● USA.gov (search the Federal Government) - https://www.usa.gov/
● U.S. Access Board (508/accessibility) - https://www.access-board.gov/
● USAJobs.gov (Federal jobs and applications) - https://www.usajobs.gov/
● U.S. Web Design System (USWDS) - https://designsystem.digital.gov/
We are family. Won’t you come join us?
Carol Highsmith photo of Cohen Building WPA Mural, 2008.
Questions & Discussion
Carol Highsmith photo of Cohen Building WPA Mural, 2012.
Thank You.
Please see appendices for colophon
and references and citations.
Jeffrey Ryan Pass
@jeffpass
#UXPA2021
Baltimore, MD
8.31.2021
Bureau of Reclamation photo of Hoover Dam construction, 1936-1946.
Appendix 1: Colophon
Fonts
Franklin Gothic: Used of headings and body content in this
presentation. Franklin Gothic consists of 5 styles designed by Morris F.
Benton and issued by ATF between 1904 and 1913. Whedon Davis
added a Condensed Italic and John L. Renshaw a Wide.
Book Antiqua: Used for image captions, notes, and citations in this
presentation. Book Antiqua is Monotype’s copy of Palatino. Palatino
was designed by Hermann Zapf in 1948 and cut in metal by August
Rosenberger at D. Stempel AG. Released in 1950 and adapted for the
Linotype machine.
Font histories adapted from Fonts In Use (https://fontsinuse.com/):
● https://fontsinuse.com/typefaces/35/franklin-gothic
● https://fontsinuse.com/typefaces/31553/book-antiqua
● https://fontsinuse.com/typefaces/3361/palatino
Imagery
This presentation leverages the theme of “public work” and
makes extensive use of New Deal ear Works Progress
Administration-funded projects and artworks as well as
historical photographs of the National Capitol, National Capital
area and Federal work projects and sites.
Photographic documentation of public works are taken from
public domain image repositories, especially those belonging to
the Library of Congress and the Smithsonian Institution. Mini
citations are provided on each slide containing such imagery
and both the notes for those individual slides and Appendix 2:
References & Citations contains full citations. Any image
cropping or other manipulations are noted.
A note on diversity, equality, and inclusion: Consistent with
the era, males are depicted disproportionately (especially
white males), however, every effort was made to ensure that
imagery and illustrations are as inclusive as the sources and
subject matter allowed.
Appendix 2: References & Citations (1 of 3)
Individual slides include mini-cites for imagery and informational graphics. The notes for each slide contains
full citations for that slide (download from https://www.slideshare.net/JeffreyRyanPass). This compiled
listing of references and citations excludes links provided Resource section unless also referenced/cited
elsewhere.
18F. 2021. “18F Product Guide.” https://product-guide.18f.gov/.
18F. n.d. “Fundamentals: Foundational methods for practicing design research” (section on Testing and Privacy).
https://methods.18f.gov/fundamentals/privacy/.
18F. n.d. “Validate: Test a design hypothesis - Usability Testing.” https://methods.18f.gov/validate/usability-testing/.
Analytics.USA.gov. August 31, 2021. Landing page. https://analytics.usa.gov/.
Coccaro, Kasie. July 13, 2011. “Campaign to Cut Waste: .gov Effort to Improve Federal Websites.” The Obama White House Archives (U.S.
National Archives): https://obamawhitehouse.archives.gov/blog/2011/07/13/campaign-cut-waste-gov-effort-improve- federal-
websites. Accessed June, 2021.
Department of Justice (DOJ) Archives. “Overview Of the Privacy Act Of 1974 (2015 Edition) (Archived).”
https://www.justice.gov/opcl/overview-privacy-act-1974-2015-edition.
Digital.gov. 2021. “Checklist of Requirements for Federal Websites and Digital Services.” https://digital.gov/resources/checklist-of-
requirements-for-federal-digital-services/.
Digital.gov. 2021. “Communities of Practice.” https://digital.gov/communities/.
Digital.gov. 2021. “Guidelines and Resources.” https://digital.gov/resources/.
Digital.gov. 2021. “PRA Digital Guide.” https://pra.digital.gov/do-i-need-clearance/.
Digital.gov. U.S. General Services Administration (GSA). Last updated August 31, 2020. https://digital.gov/resources/21st-century-
integrated-digital-experience-act/.
Appendix 2: References & Citations (2 of 3)
Executive Office of the President of the United States (Obama Administration). May 23, 2012. “Digital Government: Building A 21st Century
Platform To Better Serve The American People.” https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital-
government/digital-government.html.
FontsInUse.com. 2021. “Book Antiqua.” https://fontsinuse.com/typefaces/31553/book-antiqua.
FontsInUse.com. 2021. “Franklin Gothic.” https://fontsinuse.com/typefaces/35/franklin-gothic.
FontsInUse.com. 2021. “Palatino.” https://fontsinuse.com/typefaces/3361/palatino.
Government Accountability Office (GAO). Published: Feb 06, 2018. Publicly Released: Feb 06, 2018. GAO-18-368T: “Budget Issues:
Continuing Resolutions and Other Budget Uncertainties Present Management Challenges.” https://www.gao.gov/products/gao-18-
368t.
Harrington-Rosen, Kate. Northwestern University Office of Equality. 2021. “Progress Flag Initiative.” (Referenced in designing Progress Flag-
inspired text treatment.) https://www.northwestern.edu/equity/about/initiatives/progress-pride-flag-initiative.html.
Hoffer, David. McKinsey & Company. 2021. “Redesign Everything.” (Tee shirt design used for design inspiration.)
https://cottonbureau.com/products/redesign-everything#/4293455/tee-men-standard-tee-vintage-black-tri-blend-s.
Light, Paul C. October 7, 2020. FIXGOV (series) “The true size of government is nearing a record high”.
https://www.brookings.edu/blog/fixgov/2020/10/07/the-true-size-of-government-is-nearing-a-record-high/.
Pew Charitable Trusts (Pew). n.d. “Living Facts: Government by the Numbers.” Citation: 4.3M: PEW/Living Facts.org -
https://www.livingfacts.org/en/topics/democracy/government-by-the-numbers.
Phillips, Macon. June 13, 2011. “TooManyWebsites.gov.” From the Obama White House Archives (U.S. National Archives).
https://obamawhitehouse.archives.gov/blog/2011/06/13/toomanywebsitesgov.
Usability.gov. 2021. “Fast-Track Clearance Process for Information Collection.” https://www.usability.gov/how-to-and-
tools/guidance/fast-track-clearance-process.html.
Usability.gov. 2021. “Information Collection and Paperwork Reduction Act (PRA) Overview.” https://www.usability.gov/how-to-and-
tools/guidance/pra-overview.html.
Usability.gov. 2021. “Traditional Clearance Process for Information Collection.” https://www.usability.gov/how-to-and-
tools/guidance/traditional-clearance-process.html.
Appendix 2: References & Citations (3 of 3)
USAJobs.gov. August 31, 2021. Search for all jobs contain (no filters or search parameters).
https://www.usajobs.gov/Search/Results?hp=public&hp=fed-competitive&hp=fed-excepted&hp=fed-internal-search&hp=fed-
transition&hp=land&hp=vet&hp=mspouse&hp=nguard&hp=student&hp=graduates&hp=ses&hp=disability&hp=overseas&hp=native
&hp=peace&hp=special-authorities&p=1.
USAJobs.gov. August 31, 2021. Search for jobs containing “user experience.” -
https://www.usajobs.gov/Search/Results?hp=public&hp=fed-competitive&hp=fed-excepted&hp=fed-internal-search&hp=fed-
transition&hp=land&hp=vet&hp=mspouse&hp=nguard&hp=student&hp=graduates&hp=ses&hp=disability&hp=overseas&hp=native
&hp=peace&hp=special-authorities&p=1&k=user%20experience.
Appendix 3: Image Citations (1 of 3)
Individual slides include mini-cites for imagery and informational graphics. The notes for each slide contains
citations for that slide (download from https://www.slideshare.net/JeffreyRyanPass). Image and graphic
manipulations are noted.
Analytics.USA.gov. August 31, 2021. Analytics.USA.gov landing page. Accessed at 12:30pm (EST). https://analytics.usa.gov/. Note:
screenshot cropped for presentation; no other manipulations.
Executive Office of the President of the United States (Obama Administration). May 23, 2012. “ Digital Government: Building A 21st Century
Platform To Better Serve The American People (strategy cover). Accessed August 2021.
https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital-government/digital-government.html. Note: cover
image used with no manipulations.
Federal Writers' Project, Sponsor. Who's who in the zoo Illustrated natural history prepared by the WPA Federal Writers Project: On sale at
all book stores, zoos, and museums. New York, 1936. [NYC: Federal Art Project, or 1937] Photograph.
https://www.loc.gov/item/98514973/. Note: image used with no manipulations.
Healthcare.gov (10.2013). Healthcare.gov Waiting Room [screenshot]. Retrieved 10.03.2017 from:
https://www.healthcare.gov/marketplace/b/create-account/. Use: PD. From a screenshot taken/posted on The Count:
http://thecount.com/wp-content/uploads/healthcare.gov-waiting-room-image.jpg. Note: screenshot cropped for presentation; no other
manipulations.
Highsmith, Carol M, photographer. "New Deal" WPA art, Clarkson S. Fisher Federal Building & U.S. Courthouse, Trenton, New Jersey. New
Jersey United States Trenton. Trenton, 2010. Photograph. https://www.loc.gov/item/2010719733/. Note: image cropped for
presentation; no other manipulations.
Highsmith, Carol M, photographer. "New Deal" WPA art, Clarkson S. Fisher Federal Building & U.S. Courthouse, Trenton, New Jersey. New
Jersey United States Trenton. Trenton, 2010. Photograph. https://www.loc.gov/item/2010719733/. Note: image cropped for
presentation; no other manipulations.
Appendix 3: Image Citations (2 of 3)
Highsmith, Carol M, photographer. History of San Francisco mural by Anton Refregier at Rincon Annex Post Office located near the
Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph.
https://www.loc.gov/item/2013630281/. Note: image cropped for presentation; no other manipulations.
Highsmith, Carol M, photographer. History of San Francisco mural "An Early Newspaper Office" by Anton Refregier at Rincon Annex Post
Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco,
2012. Photograph. https://www.loc.gov/item/2013630286/. Note: image cropped for presentation; no other manipulations.
Highsmith, Carol M, photographer. History of San Francisco mural "The Waterfront" by Anton Refregier at Rincon Annex Post Office located
near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012.
Photograph. https://www.loc.gov/item/2013630294/. Note: image cropped for presentation; no other manipulations.
Highsmith, Carol M, photographer. Mural "An Incident in Contemporary American Life," by Mitchell Jamieson at the Department of Interior
Building, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634545/.
Note: image cropped for presentation; no other manipulations.
Highsmith, Carol M, photographer. Mural: "Fighting Forest Fire," by Ernest Fiene at the Department of Interior, Washington, D.C.
Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634333/. Note: image cropped for
presentation; no other manipulations.
Highsmith, Carol M, photographer. Mural: "Irrigation," by Nicolai Cikovsky at the Department of Interior, Washington, D.C. Washington
D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634335/. Note: image used with no manipulations.
Highsmith, Carol M, photographer. Mural: "Replanting the Wasteland," by Ernest Fiene at the Department of Interior, Washington, D.C.
Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634332/. Note: image used with no
manipulations.
Highsmith, Carol M, photographer. Mural: Petroleum Industry - Distribution & Use, by Edgar Britton at the Department of Interior,
Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634345/. Note: image
cropped for presentation; no other manipulations.
Appendix 3: Image Citations (3 of 3)
Highsmith, Carol M, photographer. History of San Francisco mural by Anton Refregier at Rincon Annex Post Office located near the
Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph.
https://www.loc.gov/item/2013630281/. Note: image cropped for presentation; no other manipulations.
Highsmith, Carol M, photographer. One of four immense frescoes by Conrad Albrizio representing the industries of south and north
Louisiana in the north portico of the Louisiana State Exhibit Museum in Shreveport. United States Louisiana Shreveport, 2020. -10-28.
Photograph. https://www.loc.gov/item/2020744249/. Note: image used with no manipulations.
Highsmith, Carol M, photographer. WPA mural, Cohen Building, Washington, D.C. Washington D.C. United States, 2008. December.
Photograph. https://www.loc.gov/item/2010720418/. Note: image cropped for presentation; no other manipulations.
Highsmith, Carol M, photographer. WPA mural, Cohen Building, Washington, D.C. Washington D.C. United States, 2008. December.
Photograph. https://www.loc.gov/item/2010720416/. Note: image cropped for presentation; no other manipulations.
Lang, Harold, photographer. Pentagon, Arlington County, Virginia. Construction. Work site. Workers. Virginia Arlington County, 1941. [or
1942] Photograph. https://www.loc.gov/item/2021640383/. Note: image cropped for presentation; no other manipulations.
Pass, Jeffrey. 2016. Self Portrait in LEGO®, 2016. Photograph.
Register now - informal study group WPA Workers Education Project, Henry Street Settlement. New York, None. [N.Y.C. federal art project,
between 1936 and 1941] Photograph. https://www.loc.gov/item/98514515/. Note: image used with no manipulations.
United States Bureau Of Reclamation. Three construction workers putting a coat of paint on a slanted wall of riveted-steel plates on the
Hoover Dam spillway. Hoover Dam Nevada Arizona, None. [Between 1936 and 1946] Photograph.
https://www.loc.gov/item/2008676666/. Note: image used with no manipulations.
Works Progress Administration, artist unknown - National Archives and Records Administration, Public Domain,
https://commons.wikimedia.org/w/index.php?curid=62418412. Note: image used with no manipulations.

Weitere ähnliche Inhalte

Ähnlich wie So you want to be a gov UXer... Jeffrey Ryan Pass @ UXPA International 2021

Vermont Connected - Advancing Municipal Communications
Vermont Connected - Advancing Municipal CommunicationsVermont Connected - Advancing Municipal Communications
Vermont Connected - Advancing Municipal Communicationsvtrural
 
Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...
Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...
Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...MongoDB
 
Building Information Modeling
Building Information ModelingBuilding Information Modeling
Building Information Modelingkongphooey
 
Tech Update Summary from Blue Mountain Data Systems September 2015
Tech Update Summary from Blue Mountain Data Systems September 2015Tech Update Summary from Blue Mountain Data Systems September 2015
Tech Update Summary from Blue Mountain Data Systems September 2015BMDS3416
 
Government as a Platform: What We've Learned Since 2008 (pdf with notes)
Government as a Platform: What We've Learned Since 2008 (pdf with notes)Government as a Platform: What We've Learned Since 2008 (pdf with notes)
Government as a Platform: What We've Learned Since 2008 (pdf with notes)Tim O'Reilly
 
Digital Government Strategy
Digital Government StrategyDigital Government Strategy
Digital Government StrategyEd Dodds
 
SOFIT Final Public Copy
SOFIT Final Public CopySOFIT Final Public Copy
SOFIT Final Public CopyLaura Szakmary
 
City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011
City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011
City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011Thomas Lowenhaupt
 
Now, Robot: Artificial Intelligence in 2017
Now, Robot: Artificial Intelligence in 2017Now, Robot: Artificial Intelligence in 2017
Now, Robot: Artificial Intelligence in 2017Moshe Vardi
 
Economic Development 2.0 (With Broadband)
Economic Development 2.0 (With Broadband)Economic Development 2.0 (With Broadband)
Economic Development 2.0 (With Broadband)Dustin Haisler
 
Transportation Operations In Action
Transportation Operations In ActionTransportation Operations In Action
Transportation Operations In Actionmcusack
 
Technology and Trust: The Challenge of 21st Century Government
Technology and Trust: The Challenge of 21st Century GovernmentTechnology and Trust: The Challenge of 21st Century Government
Technology and Trust: The Challenge of 21st Century GovernmentTim O'Reilly
 
Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...
Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...
Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...Andrew Hoppin
 
How much time and money can AI save government?
How much time and money can AI save government?How much time and money can AI save government?
How much time and money can AI save government?Ken Cutroneo
 
Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...
Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...
Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...eCommConf
 
Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...
Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...
Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...Christopher Regan
 

Ähnlich wie So you want to be a gov UXer... Jeffrey Ryan Pass @ UXPA International 2021 (20)

Vermont Connected - Advancing Municipal Communications
Vermont Connected - Advancing Municipal CommunicationsVermont Connected - Advancing Municipal Communications
Vermont Connected - Advancing Municipal Communications
 
Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...
Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...
Webinar: How Penton Uses MongoDB As an Analytics Platform within their Drupal...
 
Building Information Modeling
Building Information ModelingBuilding Information Modeling
Building Information Modeling
 
Tech Update Summary from Blue Mountain Data Systems September 2015
Tech Update Summary from Blue Mountain Data Systems September 2015Tech Update Summary from Blue Mountain Data Systems September 2015
Tech Update Summary from Blue Mountain Data Systems September 2015
 
Government as a Platform: What We've Learned Since 2008 (pdf with notes)
Government as a Platform: What We've Learned Since 2008 (pdf with notes)Government as a Platform: What We've Learned Since 2008 (pdf with notes)
Government as a Platform: What We've Learned Since 2008 (pdf with notes)
 
Digital Government Strategy
Digital Government StrategyDigital Government Strategy
Digital Government Strategy
 
SOFIT Final Public Copy
SOFIT Final Public CopySOFIT Final Public Copy
SOFIT Final Public Copy
 
Citymatter: UX / UI Design
Citymatter: UX / UI DesignCitymatter: UX / UI Design
Citymatter: UX / UI Design
 
City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011
City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011
City TLDs as Urban Infrastructure, PlanningTech Conference at MIT, April 8, 2011
 
Now, Robot: Artificial Intelligence in 2017
Now, Robot: Artificial Intelligence in 2017Now, Robot: Artificial Intelligence in 2017
Now, Robot: Artificial Intelligence in 2017
 
2011 AIKCU Technology Conference Keynote: How Information is Changing the Tea...
2011 AIKCU Technology Conference Keynote: How Information is Changing the Tea...2011 AIKCU Technology Conference Keynote: How Information is Changing the Tea...
2011 AIKCU Technology Conference Keynote: How Information is Changing the Tea...
 
Economic Development 2.0 (With Broadband)
Economic Development 2.0 (With Broadband)Economic Development 2.0 (With Broadband)
Economic Development 2.0 (With Broadband)
 
The Future of Digital Services
The Future of Digital ServicesThe Future of Digital Services
The Future of Digital Services
 
Transportation Operations In Action
Transportation Operations In ActionTransportation Operations In Action
Transportation Operations In Action
 
Technology and Trust: The Challenge of 21st Century Government
Technology and Trust: The Challenge of 21st Century GovernmentTechnology and Trust: The Challenge of 21st Century Government
Technology and Trust: The Challenge of 21st Century Government
 
Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...
Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...
Transparency to Innovation Civic Technology Keynote Case Study at Drupalcamp ...
 
How much time and money can AI save government?
How much time and money can AI save government?How much time and money can AI save government?
How much time and money can AI save government?
 
Burlington Comm Plan
Burlington Comm PlanBurlington Comm Plan
Burlington Comm Plan
 
Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...
Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...
Elad Barkan's Presentation at Emerging Communication Conference & Awards 2010...
 
Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...
Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...
Caliber_Media_Group_California_ProductCampSoCal2014_Product_Schema_SEO_Christ...
 

Mehr von Jeffrey Ryan Pass

Ghost In The Machine: The Soul of Design Artifacts, v2.0
Ghost In The Machine: The Soul of Design Artifacts, v2.0Ghost In The Machine: The Soul of Design Artifacts, v2.0
Ghost In The Machine: The Soul of Design Artifacts, v2.0Jeffrey Ryan Pass
 
Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...
Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...
Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...Jeffrey Ryan Pass
 
IAC20-All-Cardsorts-Great-and-Small-by-Jeff-Pass
IAC20-All-Cardsorts-Great-and-Small-by-Jeff-PassIAC20-All-Cardsorts-Great-and-Small-by-Jeff-Pass
IAC20-All-Cardsorts-Great-and-Small-by-Jeff-PassJeffrey Ryan Pass
 
From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...
From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...
From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...Jeffrey Ryan Pass
 
WIADDC19: Architecting IA Industry Events for Diversity & Inclusion
WIADDC19: Architecting IA Industry Events for Diversity & InclusionWIADDC19: Architecting IA Industry Events for Diversity & Inclusion
WIADDC19: Architecting IA Industry Events for Diversity & InclusionJeffrey Ryan Pass
 
D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)
D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)
D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)Jeffrey Ryan Pass
 
Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")
Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")
Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")Jeffrey Ryan Pass
 
Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...
Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...
Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...Jeffrey Ryan Pass
 
Everything That Rises Must Converge
Everything That Rises Must ConvergeEverything That Rises Must Converge
Everything That Rises Must ConvergeJeffrey Ryan Pass
 
Designing Against Humans: Lessons from Masterworks
Designing Against Humans: Lessons from MasterworksDesigning Against Humans: Lessons from Masterworks
Designing Against Humans: Lessons from MasterworksJeffrey Ryan Pass
 
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case Study
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case StudyAdopting IA Heuristics and Iterative UX Reviews: A USPS.com Case Study
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case StudyJeffrey Ryan Pass
 
World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...
World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...
World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...Jeffrey Ryan Pass
 
Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)
Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)
Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)Jeffrey Ryan Pass
 
Everything I Need To Know About IA/UX I Learned Playing LEGO
Everything I Need To Know About IA/UX I Learned Playing LEGOEverything I Need To Know About IA/UX I Learned Playing LEGO
Everything I Need To Know About IA/UX I Learned Playing LEGOJeffrey Ryan Pass
 
Jeff Pass UXPA 2013 Web.gov Presentation
Jeff Pass UXPA 2013 Web.gov PresentationJeff Pass UXPA 2013 Web.gov Presentation
Jeff Pass UXPA 2013 Web.gov PresentationJeffrey Ryan Pass
 
When Too Many is Just Enough: Citizen Engagement and Federal Government Websites
When Too Many is Just Enough: Citizen Engagement and Federal Government WebsitesWhen Too Many is Just Enough: Citizen Engagement and Federal Government Websites
When Too Many is Just Enough: Citizen Engagement and Federal Government WebsitesJeffrey Ryan Pass
 

Mehr von Jeffrey Ryan Pass (17)

Ghost In The Machine: The Soul of Design Artifacts, v2.0
Ghost In The Machine: The Soul of Design Artifacts, v2.0Ghost In The Machine: The Soul of Design Artifacts, v2.0
Ghost In The Machine: The Soul of Design Artifacts, v2.0
 
Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...
Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...
Architecting IA Industry Events for Diversity & Inclusion (+ Safety) - IA Rou...
 
IAC20-All-Cardsorts-Great-and-Small-by-Jeff-Pass
IAC20-All-Cardsorts-Great-and-Small-by-Jeff-PassIAC20-All-Cardsorts-Great-and-Small-by-Jeff-Pass
IAC20-All-Cardsorts-Great-and-Small-by-Jeff-Pass
 
From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...
From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...
From User Focus to DCUX: A Historical Overview of UXPA DC Conferences (aka, P...
 
WIADDC19: Architecting IA Industry Events for Diversity & Inclusion
WIADDC19: Architecting IA Industry Events for Diversity & InclusionWIADDC19: Architecting IA Industry Events for Diversity & Inclusion
WIADDC19: Architecting IA Industry Events for Diversity & Inclusion
 
D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)
D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)
D&I+S@UX-events (Diversity and Inclusion plus Safety at User Experience Events)
 
Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")
Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")
Mind Bomb (PechaKucha Silver Spring, Vol. 14: "Mind")
 
Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...
Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...
Ghost in the Machine: The Soul of Design Artifacts (PechaKucha Silver Spring ...
 
Everything That Rises Must Converge
Everything That Rises Must ConvergeEverything That Rises Must Converge
Everything That Rises Must Converge
 
Evil, Impactful IA & UX
Evil, Impactful IA & UXEvil, Impactful IA & UX
Evil, Impactful IA & UX
 
Designing Against Humans: Lessons from Masterworks
Designing Against Humans: Lessons from MasterworksDesigning Against Humans: Lessons from Masterworks
Designing Against Humans: Lessons from Masterworks
 
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case Study
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case StudyAdopting IA Heuristics and Iterative UX Reviews: A USPS.com Case Study
Adopting IA Heuristics and Iterative UX Reviews: A USPS.com Case Study
 
World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...
World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...
World IA Day 2014: Everything I Really Need to Know About IA and UX I Learned...
 
Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)
Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)
Towards a Continuous UX Improvement Model (UX Camp DC, 01.03.2014)
 
Everything I Need To Know About IA/UX I Learned Playing LEGO
Everything I Need To Know About IA/UX I Learned Playing LEGOEverything I Need To Know About IA/UX I Learned Playing LEGO
Everything I Need To Know About IA/UX I Learned Playing LEGO
 
Jeff Pass UXPA 2013 Web.gov Presentation
Jeff Pass UXPA 2013 Web.gov PresentationJeff Pass UXPA 2013 Web.gov Presentation
Jeff Pass UXPA 2013 Web.gov Presentation
 
When Too Many is Just Enough: Citizen Engagement and Federal Government Websites
When Too Many is Just Enough: Citizen Engagement and Federal Government WebsitesWhen Too Many is Just Enough: Citizen Engagement and Federal Government Websites
When Too Many is Just Enough: Citizen Engagement and Federal Government Websites
 

Kürzlich hochgeladen

Call Girls Near Surya International Hotel New Delhi 9873777170
Call Girls Near Surya International Hotel New Delhi 9873777170Call Girls Near Surya International Hotel New Delhi 9873777170
Call Girls Near Surya International Hotel New Delhi 9873777170Sonam Pathan
 
call girls in Mehrauli DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Mehrauli  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Mehrauli  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Mehrauli DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfYHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfyalehistoricalreview
 
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...narwatsonia7
 
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...narwatsonia7
 
history of 1935 philippine constitution.pptx
history of 1935 philippine constitution.pptxhistory of 1935 philippine constitution.pptx
history of 1935 philippine constitution.pptxhellokittymaearciaga
 
call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 
Start Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnoolStart Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnoolSERUDS INDIA
 
Angels_EDProgrammes & Services 2024.pptx
Angels_EDProgrammes & Services 2024.pptxAngels_EDProgrammes & Services 2024.pptx
Angels_EDProgrammes & Services 2024.pptxLizelle Coombs
 
call girls in sector 22 Gurgaon 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in sector 22 Gurgaon  🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in sector 22 Gurgaon  🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in sector 22 Gurgaon 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 
High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...
High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...
High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...Christina Parmionova
 
How to design healthy team dynamics to deliver successful digital projects.pptx
How to design healthy team dynamics to deliver successful digital projects.pptxHow to design healthy team dynamics to deliver successful digital projects.pptx
How to design healthy team dynamics to deliver successful digital projects.pptxTechSoupConnectLondo
 
High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...
High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...
High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...narwatsonia7
 
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...narwatsonia7
 
call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 
Disciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdf
Disciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdfDisciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdf
Disciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdfDeLeon9
 
(多少钱)Dal毕业证国外本科学位证
(多少钱)Dal毕业证国外本科学位证(多少钱)Dal毕业证国外本科学位证
(多少钱)Dal毕业证国外本科学位证mbetknu
 
call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 
Start Donating your Old Clothes to Poor People
Start Donating your Old Clothes to Poor PeopleStart Donating your Old Clothes to Poor People
Start Donating your Old Clothes to Poor PeopleSERUDS INDIA
 
call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️saminamagar
 

Kürzlich hochgeladen (20)

Call Girls Near Surya International Hotel New Delhi 9873777170
Call Girls Near Surya International Hotel New Delhi 9873777170Call Girls Near Surya International Hotel New Delhi 9873777170
Call Girls Near Surya International Hotel New Delhi 9873777170
 
call girls in Mehrauli DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Mehrauli  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Mehrauli  DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Mehrauli DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfYHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
 
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
 
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
No.1 Call Girls in Basavanagudi ! 7001305949 ₹2999 Only and Free Hotel Delive...
 
history of 1935 philippine constitution.pptx
history of 1935 philippine constitution.pptxhistory of 1935 philippine constitution.pptx
history of 1935 philippine constitution.pptx
 
call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Kirti Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 
Start Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnoolStart Donating your Old Clothes to Poor People kurnool
Start Donating your Old Clothes to Poor People kurnool
 
Angels_EDProgrammes & Services 2024.pptx
Angels_EDProgrammes & Services 2024.pptxAngels_EDProgrammes & Services 2024.pptx
Angels_EDProgrammes & Services 2024.pptx
 
call girls in sector 22 Gurgaon 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in sector 22 Gurgaon  🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in sector 22 Gurgaon  🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in sector 22 Gurgaon 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 
High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...
High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...
High-Level Thematic Event on Tourism - SUSTAINABILITY WEEK 2024- United Natio...
 
How to design healthy team dynamics to deliver successful digital projects.pptx
How to design healthy team dynamics to deliver successful digital projects.pptxHow to design healthy team dynamics to deliver successful digital projects.pptx
How to design healthy team dynamics to deliver successful digital projects.pptx
 
High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...
High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...
High Class Call Girls Bangalore Komal 7001305949 Independent Escort Service B...
 
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
Russian Call Girl Hebbagodi ! 7001305949 ₹2999 Only and Free Hotel Delivery 2...
 
call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Tilak Nagar DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 
Disciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdf
Disciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdfDisciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdf
Disciplines-and-Ideas-in-the-Applied-Social-Sciences-DLP-.pdf
 
(多少钱)Dal毕业证国外本科学位证
(多少钱)Dal毕业证国外本科学位证(多少钱)Dal毕业证国外本科学位证
(多少钱)Dal毕业证国外本科学位证
 
call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Narela DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 
Start Donating your Old Clothes to Poor People
Start Donating your Old Clothes to Poor PeopleStart Donating your Old Clothes to Poor People
Start Donating your Old Clothes to Poor People
 
call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
call girls in Vasant Kunj DELHI 🔝 >༒9540349809 🔝 genuine Escort Service 🔝✔️✔️
 

So you want to be a gov UXer... Jeffrey Ryan Pass @ UXPA International 2021

  • 1. So you want to be a GOV UXer… A primer for anyone interested in doing user experience work for the US Federal Government. Jeffrey Ryan Pass | @jeffpass | #UXPA2021 | Baltimore, MD, 8.31.21 Harold Lang photo of Pentagon construction, ~1941.
  • 2. A note on the design theme for this presentation To work in the Public Sector is to perform public work. Whether your call it User UX, CX (as Customer Experience), or CX (as Citizen Experience), the work of GOV UXers it at the vanguard of digital pubic work. Given this notion and the topic of this presentation, most imagery and illustrations used depict public work projects and artworks. Most of these were commissioned and funded by the New Deal ear Works Progress Administration (WPA) and date back to the 1930s and 1940s. Selections were made to reflect maximum diversity and inclusion given the era and limited image options. The Works Progress Administration logo (1936).
  • 3. The presentation will cover: ● Some GOV UX stats that might surprise you ● A brief history of Federal rules/regs affecting UX ● Agencies, actors, and influencers to know ● Federal web culture fundamentals ● Usability testing rules and regs ● Citizen engagement goals and techniques ● Resources and communities for GOV UXers ● Appendices including (1) Colophon, (2) References & Citations (3) Image Citations But first some quick background on your presenter; a.k.a., why this guy?
  • 4. Jeffrey Ryan Pass In 23+ years on the front lines of US Federal GOV UX I’ve: ● Worked for dozens of federal agencies on hundreds of projects, including some of the highest profile government sites, applications, and initiatives. ● Been involved in key research, policies, organizations, and teams that have shaped US digital government. ● Supported and organized DMV-area (Maryland, District of Columbia, and Virginia) UX events and communities of practice (COPs), as well as regional, national, and international industry conferences. I’ve even taught fundamentals of UX and IA (distinct courses) using the LEGO®SERIOUS PLAY®methodology. LEGO® self portrait, 2016. Feel free to contact me: Twitter: @jeffpass LinkedIn: jeffreyryanpass
  • 5. Some GOV UX stats that might surprise you Carol Highsmith photo of Anton Refregier WPA Mural, 2012.
  • 6. How many is too many? In 2011 there were almost 2,000 separate Federal Government websites prompting Macom Phillips, then director of the Office of Digital Strategy under President Barack Obama, to create the campaign TooManyWebsites.gov. ● The effort (part of the Obama Federal Digital Strategy) managed to produce an inventory of all government sites and to reduce the number of sites significantly. ● The effort was abandoned by the next administration and has not yet been picked up by the current administration. ● There currently is not a published listing of all .gov, .mil, and related U.S. Government domains managed by federal executive branch agencies.
  • 7. Federal website traffic APIs (application programming interfaces) from NOAA, USPS, and other agencies power weather reports, package tracking, and countless other tools and applications around the world accounting for immeasurable traffic. Additionally... ● 14B sessions and 38B page views of federal websites in 2019 (GSA, 2021) ● In 2021 thats grown to 5B+ visits every 90 days (Analytics.gov, 2021) ● USPS and IRS web domains typically appear among the top 100 US-based websites (by traffic), and sometimes in the top 50 (Alexa) ● During COVID, NIH.gov has remained in the top 50 sites (Alexa) Analytics.USA.gov (1 hour ago).
  • 8. Federal government workforce ● 4.3 million federal gov employees (Pew, 2021) ● ~10 million government workers if you include civil servants, postal workers, active military, contractors, and grantees. (Brookings, 2020) ● Contractors typically make up ~50% of government workers (Brookings, 2020) ● There are more than 10,000 federal jobs currently open (USAJobs.gov) ● Including 175 tagged with “user experience” as of this morning (USAJobs.gov) ● There are easily as many federal contract jobs currently open Nicolai Cikovski WPA mural, “Irrigration”, photographed 2011.
  • 9. A brief history of Federal rules/regs affecting UX Carol Highsmith photo of Mitchell Jamieson WPA Mural, 2011.
  • 10. Rules, regs, and limitations affecting UX work (1 of 3) The following provides a high level listing of notable milestones, rules, and regulations that directly affect day-to-day life as a GOV Uxer. 1968: Architectural Barriers Act (ABA) of 1968 1973: Rehabilitation Act of 1973 (Rehab Act) 1990: Americans with Disabilities Act 1991: Americans with Disabilities Act Accessibility Guidelines (ADAAG) 1996: Telecommunications Act of 1996 1998: Telecommunications Act Accessibility Guidelines 2000: Section 508 Standards 2002: E-Government Act of 2002 2004: The Research-Based Web Design & Usability Guidelines 2005: Report of the Citizen Services Levels Interagency Committee CSLIC 2006: The Research-Based Web Design & Usability Guidelines (Update) 2008: - Federal WEb Managers Council White Paper: Putting Citizens First: Transforming - Online Government - Web Content Accessibility Guidelines (WCAG) 2.0
  • 11. Rules, regs, and limitations affecting UX work (2 of 3) 2009: Open Government Directive 2010: - Social Media, Web-Based Interactive Technologies, and the Paperwork Reduction Act - Plain Writing Act of 2010 - OMB M-10-22, Guidance for Online Use of Web Measurement and Customization Technologies - Final Rule – 41 CFR Part 102-173 Internet Gov Domain - Twenty-First Century Communications and Video Accessibility Act 2011: OMB M-11-26 – Fast-Track Process for Collecting Service Delivery Feedback Under the Paperwork Reduction Act 2012: - 2012 Digital Government Strategy (Federal Digital Strategy) - Executive Order 13571, Streamlining Service Delivery and Improving Customer Service - Executive Order 13576, Delivering an Efficient, Effective, and Accountable Government 2014: US Digital Services Playbook 2015: - United States Web Design System - Policies for DotGov Domain Issuance for Federal Agency Public Websites
  • 12. Rules, regs, and limitations affecting UX work (3 of 3) 2015: Executive Memorandum M-15-13, Policy to Require Secure Connections across Federal Websites and Web Services (The HTTPS-Only Standard) 2016: - OMB M-17-06, Policies for Federal Agency Public Websites and Digital Services - OMB Circular A-130, Managing Information as a Strategic Resource - Executive Memorandum M-16-21, Federal Source Code Policy (FSCP) 2017: - Section 508 of the Rehabilitation Act and Section 255 of the Communications Act - (updated) - Executive Memorandum M-13-13, Open Data Policy-Managing Information as an Asset 2018: - Connected Government Act - 21st Century Integrated Digital Experience Act (IDEA) 2020: Executive Memorandum M-21-07, Completing the Transition to Internet Protocol Version 6 (IPv6)
  • 13. Agencies, actors, and influencers to know Carol Highsmith photo of Edgar Britton WPA Mural, 2011.
  • 14. U.S. Government: ● 18F (gov digital service bureau, part of GSA) - https://18f.gsa.gov/ ● Access Board (disability equality) - https://www.access-board.gov/ ● Federal Chief Information Officers (CIOs) Council (CIO Council + CIO.gov) - https://www.cio.gov/ ● Federal Web Managers Council - https://digital.gov/resources/federal-web- council/ ● United States Digital Service (USDS) (part of the Executive Office of the President) - https://www.usds.gov/
  • 15. Foreign counterpart and non-governmental organizations: ● Australian Digital Transformation Agency - https://www.dta.gov.au/ ● Gov.UK - https://www.gov.uk/ ● UK Government Service Manual - https://www.gov.uk/service-manual ● New Zealand Digital Government - https://www.digital.govt.nz/ ● Netherlands Digital Government - https://www.nldigitalgovernment.nl/ ● Netherlands Digital Government Agenda - https://www.nldigitalgovernment.nl/digital-government-agenda/ ● OECD Digital Government (Office of Economic Cooperation and Development) - https://www.oecd.org/gov/digital-government/ ● OECD Digital Government Toolkit - https://www.oecd.org/governance/digital- government/toolkit/
  • 16. Federal web culture fundamentals Carol Highsmith photo of Clarkson S. Fisher Building WPA Mural, 2010.
  • 17. As a new GOV UXer you may feel like you want to REDESIGN EVERYTHING! And that’s the right idea, but…
  • 18. You will encounter frictions: ● The value/importance of UX is not universally recognized, and… ● Even when it is, it is not always prioritized or funded, plus… ● UX and design are often brought in late, sometimes as an afterthought Conrad Albrizo WPA fresco of Louisiana industries, ~1939.
  • 19. Often UXers are Firefighters: ● We are often brought in after the fact to fix problems ● Or inherit antiquated designs, architectures, and content strategies that we’re expected to maintain while improving while redesigning ● We’re often called upon to provide front-end solutions to back-end problems 1938 Ernest Fiene WPA mural of firefighters fighting a blaze.
  • 21. Federal government agencies are all different and... ● Are often decentralized; agencies and operating divisions (op divs) have their own culture, rules, regs ● Tend to organize (and share) information based or organizational structure or internal ‘domain’ knowledge ● Struggle with the classic IT vs. communications vs. marketing dilemma with regard to digital domain ownership and management ● Have longer project runways and implementation and maintenance timelines Plus, they have a tendency to pay lip service to Agile, SCRUM, and other methodologies (as well as UX best practices) that are frequently diluted or perverted when applied within a government agency bureaucracy. (But really, isn’t that everywhere?)
  • 22. And agencies are subject to... ● Both federal and agency-specific regulations that are often more vigorously monitored and enforced than in the private sector ● Continuing resolutions (CR) and other budget uncertainties (including sequestration and shut-downs) not present in the private sector ○ In all but 4 of the last 40 years, Congress has passed CRs to keep agencies running between budgets ● Politicization of agency budgets, scope, operations, etc. ● Federal and agency inertia and fiduciary obligations to the public that result in an aversion to risk and that can make innovation difficult But they are also committed
  • 23. Still, they are committed to their missions and the public As UX (and Citizen Experience) become less of an afterthought, the roadblocks to doing UX work have become fewer and farther in between. ● Many agencies (and all Cabinet-level agencies) have embraced the value of UX and usability testing and have reduced impediments to UXers. ● PRA exceptions better understood and PRA Clearance Officers are increasingly savvy about helping facilitate usability studies. ● Many agencies have their own usability testing labs, that are often available to other federal agencies, though COVID has temporarily (hopefully) shuttered many of these labs.
  • 24. So, all that said, if you are interested in positively impacting the lives of Americans, government work is an... AMAZING OPPORTUNITY ...to work with some great people and make a real difference!
  • 25. Usability testing rules and regulations Carol Highsmith photo of Anton Refregier WPA Mural, 2012.
  • 26. The Paperwork Reduction Act As it relates to usability studies
  • 27. The Paperwork Reduction Act (PRA) of 1995 ● Established to reduce the amount of paperwork burden imposed on citizens and private businesses ● Requires U.S. federal government agencies to obtain Office of Management and Budget (OMB) approval before collecting most types of information from the public ● Includes two processes for obtaining clearance through OMB: ○ Traditional Clearance (6-9 months) ○ Fast-Track Clearance (~5-days per request, but qualifying takes 6+ months)
  • 28. The PRA Applies ● To any data collection vehicle involving 10 or more participants and utilizing standardized questions ● To any type of respondent (individuals, organizations, states, etc.) ● Regardless of form or format (interview, survey, etc.) ● Regardless of collection method (in-person, telephonic, electronic) But PRA does not apply to: ● Direct observation and non-standardized conversation (5 CFR 1320.3(h)3) ● Direct tests of knowledge or aptitude (5 CFR 1320.3(h)7) ● Federal employees (and some agencies extend this to their contractors)
  • 29. Federal Agencies and PRA ● Agencies are required to have a PRA Clearance Officer ○ This role is often combined with other compliance roles (e.g., the FOIA Liaison) ○ If you are at an Operational Division (Op Div), Commission, or sub-agency organization, your PRA Clearance Officer may sit at the parent agency-level ● Never start work on a Traditional Clearance request before confirming whether the agency is Fast-Track approved ● If your agency does not have Fast-Track, work with your PRA Clearance Officer to pursue it ○ The level of effort (LOE) is comparable to securing a Traditional Clearance, but once attained, individual clearances can be achieved quickly and with a low LOE
  • 30. PRA Traditional Clearance ● Used for individual collection requests ● Typically takes 6-9 months, including: ○ 60-day* and 30-day** public comment periods ○ 60-day OMB response periods following each public comment period Four step process: 1. Prepare/publish requirements in the Federal Register* 2. Prepare Information Collection Request (ICR) package 3. Publish ICR and Supporting Statement to in the Federal Register** 4. Submit proposed collection to OMB and publish in Federal Register** Followed by individual request approval/rejection
  • 31. PRA Fast-Track Clearance: Eligibility Only available for a subset of collection activities: ● Focus groups ● One-time panels and discussion groups ● Usability studies ● Post transaction surveys, and online surveys To be Fast-Track eligible, collections must: ● Be voluntary ● Involve no significant burden to respondents ● Not require extensive statistical analysis ● Not involve public dissemination of results
  • 32. PRA Fast-Track Clearance: Generic Clearance Fast-Track Clearance is a two-part process: ● Securing Generic Clearance ● Securing clearance for individual Information Collection Requests (ICRs) There are 7 steps to securing generic Fast-Track clearance: 1. Prepare a generic draft ICR 2. Review/revision/approval by PRA Clearance Officer 3. Submit 30-day Federal Register Notice 4. Finalize draft, review/revision/approval by PRA Clearance Officer 5. PRA Clearance Officer sends ICR to OMB 6. OMB review/revision/approval 7. OMB issues a Notification of Action (NOA: approve, disapprove, withdrawal)
  • 33. PRA Fast-Track Clearance: ICR Clearance Once Generic Clearance is secured, individual ICR clearance request can be submitted. There are 5 steps to securing each individual ICR clearance: 1. Prepare ICR using short form 2. Review/revision/approval by PRA Clearance Officer 3. PRA Clearance Officer sends ICR to OMB 4. OMB has 5 days to review the ICR 5. OMB issues an NOA (approve, disapprove, withdrawal) (OMB failure to review within 5 days = automatic approval)
  • 34. PRA Clearance: Statutory Requirements Once Traditional or Fast-Track PRA clearance has been granted, the collection must include/display the following clearance documentation: ● OMB control number ● Expiration date ● Expected burden ● Public protection clause
  • 35. Recruiting & Incentives For Usability Studies
  • 36. Discussing Recruiting & Incentives Because of various federal rules and best practices, we must be careful how we discuss recruiting and incentives (especially incentives). ● Incentives: we use the words “incentive” and “stipend” to describe compensation for participation in a usability test, focus group, or other, similar activity ● We do not use words/phrases like: “pay,” “payment,” “reimburse,” or “compensate” ● Reasoning: recruiting incentives do not require W9s or formal invoicing in the way that payments (and similar compensation-related transactions) do; therefore it is important to avoid such language.
  • 37. Third-Party Partners for Recruiting More often than not, federal agencies and their primary contractors do not undertake recruiting activities or the management of recruiting for usability studies and related activities due to PII concerns related to recruiting, data collection, and data maintenance. Instead, they use third-party partners to perform recruiting activities, including: ● Developing and maintaining recruiting databases ● Recruiting, vetting, and scheduling test participants ● Providing incentives to participants after test completion
  • 38. Handling Incentives For federal agencies: ● Developing and maintaining recruiting databases ● Recruiting, vetting, and scheduling test participants ● Providing incentives to participants after test completion For contracting organizations and contractors: ● Ability and budget must be stipulated in the client contract, or... ● Expressly allowed as an acceptable use for ODC (Other Direct Costs) budgets ● Must follow all contractual and IRS requirements regarding recording and disclosure, including the possible issuance of W9s
  • 39. When You Don’t Need a Third-Party Partner There are several exceptions to the third-party partner recruiting rule: ● When ‘anonymous’ recruiting can be performed via client social media ○ E.g., inviting Facebook followers to anonymously opt-in to an unmoderated, online usability activity like a card sort or tree test ● When the client has a listing of ‘opted-in’ participants ○ E.g., client site visitors that volunteered to participate in usability studies when completing a voice-of-the-consumer survey ○ E.g., federal employees of the client agency (no incentives may be provided) ● When you are performing “guerrilla testing” ○ E.g., when performing ‘impromptu’ testing at a client site, conference, mall, etc.
  • 40. Citizen engagement goals and techniques Carol Highsmith photo of Cohen Building WPA Mural, 2008.
  • 41. Citizen engagement is required The Obama White House’s Federal Digital Strategy required that all Federal Government websites be “customer-centric” and that they “offer easy paths for feedback to ensure we continually improve service delivery.” Therein lies one of the best mechanisms for engaging citizens in UX work. Obama Administration Federal Digital Strategy; quotes and cover (2012)
  • 42. Engage/recruit where users are ● Many federal digital customer feedback surveys include an opt-in for respondents to allow that agency to contact them by way of follow-up and to engage them in surveys, user research, etc. ● Most agencies have a social media presence, often including accounts on numerous platforms and frequently for top-level departments and op divs within the agency. ● Numerous agencies have blog or syndicated communications. All are fertile ground for recruiting. Obama Administration Federal Digital Strategy; quotes and cover (2012)
  • 43. Opt-in recruiting Email list blasts, social media posts, direct responses to customer feedback, and similar methods can be used to allow would-be participants to opt into studies. Respondents are typically directed to a recruiting screener/survey that: ● Collect the minimum required PII for recruitment ● Use general demographic questions to allow for data segmentation without unnecessary PII collection WPA study group registration poster (1936-1941)
  • 44. Guerrilla Usability Testing Many agencies offer services at locations around the country providing an excellent opportunity to engage users where they transact in-person. ● When the client has a listing of ‘opted-in’ participants ● When you are performing “guerrilla testing” ○ E.g., when performing ‘impromptu’ testing at a client site, conference, mall, etc. WPA Federal Writers’ Project book cover (1937)
  • 45. Resources and communities for GOV UXers Carol Highsmith photo of Cohen Building WPA Mural, 2008.
  • 46. ● Overarching Policies ● Accessibility / Section 508 ● Analytics ● Coordination During Incidents of National Significance ● Copyright ● Customer Experience ● Design ● Domains ● Freedom of Information Act (FOIA) ● Governance ● Information Quality ● Mandatory Content ● Mobile ● Multilingual Websites ● Open Govt./Data/Content ● Paperwork Reduction ● Performance Measurement and Reporting ● Plain Writing ● Privacy and Identity Management ● Prohibition on Advertising ● Records Management ● Search ● Security ● Technology Standards ● Third-Party Services/ ● Social Media Digital.gov requirements for federal web & digital services The GSA (U.S. General Services Administration) website Digital.gov (https://digital.gov/) is an invaluable resource. It contains THE requirements checklist for Federal Websites and Digital Services (which is updated frequently): https://digital.gov/resources/checklist-of-requirements-for-federal-digital-services/. Curated listings of resources are organized by topic, including:
  • 47. ● 21st Century IDEA ● Accessibility ● Agile ● Content ● Content Strategy ● Crowdsourcing ● Customer Experience ● Data ● Design ● Governance ● Metrics ● Mobile ● Multilingual ● Open Data ● Performance ● Plain Language ● Policies & Regulations ● Privacy ● Product Management ● Project Management ● Research ● Security ● Social Media ● Strategy ● Training ● Usability ● User Experience ● User Research ● Web Design Systems ● And much more! Digital.gov guides and resources The GSA is also one of the best resources for information, guides, resources, tools, and services: https://digital.gov/resources/. Curated listings of resources are organized by topic, including:
  • 48. 18F resources The GSA’s 18F is another important collection of resources and products: https://product-guide.18f.gov/. Product management in government: ● Guide to product management ● The importance of gov product management General: ● 18F / TTS Handbook ● Getting started at TTS: Your first 90 days ● 18F Project Catalogue ● 18F Project Resources Library ● 18F Methods ● Checklist of requirements for federal government websites ● USDS Playbook Guides: ● Project Start Guide ● 18F De-risking Government Technology Guide ● 18F User Experience Design Guide ● 18F Content Guide ● TTS Engineering Guide Front-end practices ● 18F Analytics standards ● 18F Accessibility Guide ● Agile Principles and 18F Practices ● Before You Ship: TTS guide to launching software
  • 49. Government COPs (communities of practice) The Federal Government has many digital-focused COPs listed at https://digital.gov/communities/ and including: ● Agile/Lean ● APIs ● Artificial Intelligence (AI) ● Blockchain ● Challenge & Prize ● Cloud and Infrastructure ● Crowsourcing & Citizen Science ● Customer Experience ● DevOps ● Federal Communicators ● Federal Leadership and Professional Development ● Federal Technology Investment Management ● Government Contact Center Council (G3C) ● Innovation Adoption ● IT Accessibility/Section 508 ● Mobile ● Multilingual ● Open Data ● Open Source ● OpenGov ● Plain Language ● Results-Oriented Accountability for Grants ● Robotic Process Automation (RPA) ● Social Media ● U.S. Web Design System ● User Experience ● Video Production Pros ● VR & AR ● Web Analytics and Optimization ● Web Managers
  • 50. Important Federal Government sites/resources (1 of 2) While some of these show up in the Digital.gov Accessibility Resources page, each is worthy of top-level placement in any listing of GOV UXer resources: ● Accessibility.gov (508/accessibility) - https://accessibility.gov/ ● Analytics.USA.gov - https://analytics.usa.gov/ ● API.Data.gov (API management service for agencies) - https://api.data.gov/about/ ● Benefits.gov (state and federal employee benefits) - https://www.benefits.gov/ ● CIO.gov (Federal Chief Information Officers forum) - https://cio.gov/ ● Data.gov (gov open data) - https://www.data.gov/ ● Digital Analytics Program (DAP) - https://digital.gov/guides/dap/ ● Digital Government: Building a 21st Century Digital Government (Obama Whitehouse Archives) - https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital-government/ digital- government.html ● Digital.gov Events - https://digital.gov/events/ ● Digital Services Playbook (United States Digital Service) - https://playbook.cio.gov/ ● Federal Communities of Practice (Fed COPs) - https://digital.gov/communities/ ● Federal Register (the gov daily journal) - https://www.federalregister.gov/ ● Federal Tools and Services - https://digital.gov/services/ ● General Services Administration (GSA) - https://www.gsa.gov/
  • 51. Important Federal Government sites/resources (2 of 2) ● IT Dashboard (Federal IT Investment performance) - https://www.itdashboard.gov/ ● Office of E-Government & Information Technology - https://www.whitehouse.gov/omb/management/egov/ ● Office of Personnel Management (OPM) - https://www.opm.gov/ ● Official U.S. Executive Branch Websites (Library of Congress-managed listing) - https://www.loc.gov/rr/news/fedgov.html ● Research-Based Web Design & Usability Guidelines (Usability.gov, HHS, and GSA sponsored) - https://www.usability.gov/sites/default/files/documents/guidelines_book.pdf ● Plain Language.gov (plain writing) - https://www.plainlanguage.gov/ ● Regulations.gov (review and comment on regulations) - https://www.regulations.gov/ ● Section508.gov (508/accessibility) - https://www.section508.gov/ ● TechFAR Hub (digital service acquisition best practices) - https://techfarhub.cio.gov/ ● Usability.gov - https://www.usability.gov/ ● USA.gov (search the Federal Government) - https://www.usa.gov/ ● U.S. Access Board (508/accessibility) - https://www.access-board.gov/ ● USAJobs.gov (Federal jobs and applications) - https://www.usajobs.gov/ ● U.S. Web Design System (USWDS) - https://designsystem.digital.gov/
  • 52. We are family. Won’t you come join us? Carol Highsmith photo of Cohen Building WPA Mural, 2008.
  • 53. Questions & Discussion Carol Highsmith photo of Cohen Building WPA Mural, 2012.
  • 54. Thank You. Please see appendices for colophon and references and citations. Jeffrey Ryan Pass @jeffpass #UXPA2021 Baltimore, MD 8.31.2021 Bureau of Reclamation photo of Hoover Dam construction, 1936-1946.
  • 55. Appendix 1: Colophon Fonts Franklin Gothic: Used of headings and body content in this presentation. Franklin Gothic consists of 5 styles designed by Morris F. Benton and issued by ATF between 1904 and 1913. Whedon Davis added a Condensed Italic and John L. Renshaw a Wide. Book Antiqua: Used for image captions, notes, and citations in this presentation. Book Antiqua is Monotype’s copy of Palatino. Palatino was designed by Hermann Zapf in 1948 and cut in metal by August Rosenberger at D. Stempel AG. Released in 1950 and adapted for the Linotype machine. Font histories adapted from Fonts In Use (https://fontsinuse.com/): ● https://fontsinuse.com/typefaces/35/franklin-gothic ● https://fontsinuse.com/typefaces/31553/book-antiqua ● https://fontsinuse.com/typefaces/3361/palatino Imagery This presentation leverages the theme of “public work” and makes extensive use of New Deal ear Works Progress Administration-funded projects and artworks as well as historical photographs of the National Capitol, National Capital area and Federal work projects and sites. Photographic documentation of public works are taken from public domain image repositories, especially those belonging to the Library of Congress and the Smithsonian Institution. Mini citations are provided on each slide containing such imagery and both the notes for those individual slides and Appendix 2: References & Citations contains full citations. Any image cropping or other manipulations are noted. A note on diversity, equality, and inclusion: Consistent with the era, males are depicted disproportionately (especially white males), however, every effort was made to ensure that imagery and illustrations are as inclusive as the sources and subject matter allowed.
  • 56. Appendix 2: References & Citations (1 of 3) Individual slides include mini-cites for imagery and informational graphics. The notes for each slide contains full citations for that slide (download from https://www.slideshare.net/JeffreyRyanPass). This compiled listing of references and citations excludes links provided Resource section unless also referenced/cited elsewhere. 18F. 2021. “18F Product Guide.” https://product-guide.18f.gov/. 18F. n.d. “Fundamentals: Foundational methods for practicing design research” (section on Testing and Privacy). https://methods.18f.gov/fundamentals/privacy/. 18F. n.d. “Validate: Test a design hypothesis - Usability Testing.” https://methods.18f.gov/validate/usability-testing/. Analytics.USA.gov. August 31, 2021. Landing page. https://analytics.usa.gov/. Coccaro, Kasie. July 13, 2011. “Campaign to Cut Waste: .gov Effort to Improve Federal Websites.” The Obama White House Archives (U.S. National Archives): https://obamawhitehouse.archives.gov/blog/2011/07/13/campaign-cut-waste-gov-effort-improve- federal- websites. Accessed June, 2021. Department of Justice (DOJ) Archives. “Overview Of the Privacy Act Of 1974 (2015 Edition) (Archived).” https://www.justice.gov/opcl/overview-privacy-act-1974-2015-edition. Digital.gov. 2021. “Checklist of Requirements for Federal Websites and Digital Services.” https://digital.gov/resources/checklist-of- requirements-for-federal-digital-services/. Digital.gov. 2021. “Communities of Practice.” https://digital.gov/communities/. Digital.gov. 2021. “Guidelines and Resources.” https://digital.gov/resources/. Digital.gov. 2021. “PRA Digital Guide.” https://pra.digital.gov/do-i-need-clearance/. Digital.gov. U.S. General Services Administration (GSA). Last updated August 31, 2020. https://digital.gov/resources/21st-century- integrated-digital-experience-act/.
  • 57. Appendix 2: References & Citations (2 of 3) Executive Office of the President of the United States (Obama Administration). May 23, 2012. “Digital Government: Building A 21st Century Platform To Better Serve The American People.” https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital- government/digital-government.html. FontsInUse.com. 2021. “Book Antiqua.” https://fontsinuse.com/typefaces/31553/book-antiqua. FontsInUse.com. 2021. “Franklin Gothic.” https://fontsinuse.com/typefaces/35/franklin-gothic. FontsInUse.com. 2021. “Palatino.” https://fontsinuse.com/typefaces/3361/palatino. Government Accountability Office (GAO). Published: Feb 06, 2018. Publicly Released: Feb 06, 2018. GAO-18-368T: “Budget Issues: Continuing Resolutions and Other Budget Uncertainties Present Management Challenges.” https://www.gao.gov/products/gao-18- 368t. Harrington-Rosen, Kate. Northwestern University Office of Equality. 2021. “Progress Flag Initiative.” (Referenced in designing Progress Flag- inspired text treatment.) https://www.northwestern.edu/equity/about/initiatives/progress-pride-flag-initiative.html. Hoffer, David. McKinsey & Company. 2021. “Redesign Everything.” (Tee shirt design used for design inspiration.) https://cottonbureau.com/products/redesign-everything#/4293455/tee-men-standard-tee-vintage-black-tri-blend-s. Light, Paul C. October 7, 2020. FIXGOV (series) “The true size of government is nearing a record high”. https://www.brookings.edu/blog/fixgov/2020/10/07/the-true-size-of-government-is-nearing-a-record-high/. Pew Charitable Trusts (Pew). n.d. “Living Facts: Government by the Numbers.” Citation: 4.3M: PEW/Living Facts.org - https://www.livingfacts.org/en/topics/democracy/government-by-the-numbers. Phillips, Macon. June 13, 2011. “TooManyWebsites.gov.” From the Obama White House Archives (U.S. National Archives). https://obamawhitehouse.archives.gov/blog/2011/06/13/toomanywebsitesgov. Usability.gov. 2021. “Fast-Track Clearance Process for Information Collection.” https://www.usability.gov/how-to-and- tools/guidance/fast-track-clearance-process.html. Usability.gov. 2021. “Information Collection and Paperwork Reduction Act (PRA) Overview.” https://www.usability.gov/how-to-and- tools/guidance/pra-overview.html. Usability.gov. 2021. “Traditional Clearance Process for Information Collection.” https://www.usability.gov/how-to-and- tools/guidance/traditional-clearance-process.html.
  • 58. Appendix 2: References & Citations (3 of 3) USAJobs.gov. August 31, 2021. Search for all jobs contain (no filters or search parameters). https://www.usajobs.gov/Search/Results?hp=public&hp=fed-competitive&hp=fed-excepted&hp=fed-internal-search&hp=fed- transition&hp=land&hp=vet&hp=mspouse&hp=nguard&hp=student&hp=graduates&hp=ses&hp=disability&hp=overseas&hp=native &hp=peace&hp=special-authorities&p=1. USAJobs.gov. August 31, 2021. Search for jobs containing “user experience.” - https://www.usajobs.gov/Search/Results?hp=public&hp=fed-competitive&hp=fed-excepted&hp=fed-internal-search&hp=fed- transition&hp=land&hp=vet&hp=mspouse&hp=nguard&hp=student&hp=graduates&hp=ses&hp=disability&hp=overseas&hp=native &hp=peace&hp=special-authorities&p=1&k=user%20experience.
  • 59. Appendix 3: Image Citations (1 of 3) Individual slides include mini-cites for imagery and informational graphics. The notes for each slide contains citations for that slide (download from https://www.slideshare.net/JeffreyRyanPass). Image and graphic manipulations are noted. Analytics.USA.gov. August 31, 2021. Analytics.USA.gov landing page. Accessed at 12:30pm (EST). https://analytics.usa.gov/. Note: screenshot cropped for presentation; no other manipulations. Executive Office of the President of the United States (Obama Administration). May 23, 2012. “ Digital Government: Building A 21st Century Platform To Better Serve The American People (strategy cover). Accessed August 2021. https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital-government/digital-government.html. Note: cover image used with no manipulations. Federal Writers' Project, Sponsor. Who's who in the zoo Illustrated natural history prepared by the WPA Federal Writers Project: On sale at all book stores, zoos, and museums. New York, 1936. [NYC: Federal Art Project, or 1937] Photograph. https://www.loc.gov/item/98514973/. Note: image used with no manipulations. Healthcare.gov (10.2013). Healthcare.gov Waiting Room [screenshot]. Retrieved 10.03.2017 from: https://www.healthcare.gov/marketplace/b/create-account/. Use: PD. From a screenshot taken/posted on The Count: http://thecount.com/wp-content/uploads/healthcare.gov-waiting-room-image.jpg. Note: screenshot cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. "New Deal" WPA art, Clarkson S. Fisher Federal Building & U.S. Courthouse, Trenton, New Jersey. New Jersey United States Trenton. Trenton, 2010. Photograph. https://www.loc.gov/item/2010719733/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. "New Deal" WPA art, Clarkson S. Fisher Federal Building & U.S. Courthouse, Trenton, New Jersey. New Jersey United States Trenton. Trenton, 2010. Photograph. https://www.loc.gov/item/2010719733/. Note: image cropped for presentation; no other manipulations.
  • 60. Appendix 3: Image Citations (2 of 3) Highsmith, Carol M, photographer. History of San Francisco mural by Anton Refregier at Rincon Annex Post Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph. https://www.loc.gov/item/2013630281/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. History of San Francisco mural "An Early Newspaper Office" by Anton Refregier at Rincon Annex Post Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph. https://www.loc.gov/item/2013630286/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. History of San Francisco mural "The Waterfront" by Anton Refregier at Rincon Annex Post Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph. https://www.loc.gov/item/2013630294/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. Mural "An Incident in Contemporary American Life," by Mitchell Jamieson at the Department of Interior Building, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634545/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. Mural: "Fighting Forest Fire," by Ernest Fiene at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634333/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. Mural: "Irrigation," by Nicolai Cikovsky at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634335/. Note: image used with no manipulations. Highsmith, Carol M, photographer. Mural: "Replanting the Wasteland," by Ernest Fiene at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634332/. Note: image used with no manipulations. Highsmith, Carol M, photographer. Mural: Petroleum Industry - Distribution & Use, by Edgar Britton at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634345/. Note: image cropped for presentation; no other manipulations.
  • 61. Appendix 3: Image Citations (3 of 3) Highsmith, Carol M, photographer. History of San Francisco mural by Anton Refregier at Rincon Annex Post Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph. https://www.loc.gov/item/2013630281/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. One of four immense frescoes by Conrad Albrizio representing the industries of south and north Louisiana in the north portico of the Louisiana State Exhibit Museum in Shreveport. United States Louisiana Shreveport, 2020. -10-28. Photograph. https://www.loc.gov/item/2020744249/. Note: image used with no manipulations. Highsmith, Carol M, photographer. WPA mural, Cohen Building, Washington, D.C. Washington D.C. United States, 2008. December. Photograph. https://www.loc.gov/item/2010720418/. Note: image cropped for presentation; no other manipulations. Highsmith, Carol M, photographer. WPA mural, Cohen Building, Washington, D.C. Washington D.C. United States, 2008. December. Photograph. https://www.loc.gov/item/2010720416/. Note: image cropped for presentation; no other manipulations. Lang, Harold, photographer. Pentagon, Arlington County, Virginia. Construction. Work site. Workers. Virginia Arlington County, 1941. [or 1942] Photograph. https://www.loc.gov/item/2021640383/. Note: image cropped for presentation; no other manipulations. Pass, Jeffrey. 2016. Self Portrait in LEGO®, 2016. Photograph. Register now - informal study group WPA Workers Education Project, Henry Street Settlement. New York, None. [N.Y.C. federal art project, between 1936 and 1941] Photograph. https://www.loc.gov/item/98514515/. Note: image used with no manipulations. United States Bureau Of Reclamation. Three construction workers putting a coat of paint on a slanted wall of riveted-steel plates on the Hoover Dam spillway. Hoover Dam Nevada Arizona, None. [Between 1936 and 1946] Photograph. https://www.loc.gov/item/2008676666/. Note: image used with no manipulations. Works Progress Administration, artist unknown - National Archives and Records Administration, Public Domain, https://commons.wikimedia.org/w/index.php?curid=62418412. Note: image used with no manipulations.

Hinweis der Redaktion

  1. Image: Lang, Harold, photographer. Pentagon, Arlington County, Virginia. Construction. Work site. Workers. Virginia Arlington County, 1941. [or 1942] Photograph. https://www.loc.gov/item/2021640383/. Note: image cropped for presentation; no other manipulations.
  2. By Works Progress Administration, artist unknown - National Archives and Records Administration, Public Domain, https://commons.wikimedia.org/w/index.php?curid=62418412. Note: image used with no manipulations.
  3. LEGO®SERIOUS PLAY®: https://www.lego.com/en-us/seriousplay Image: Pass, Jeffrey. 2016. Self portrait in LEGO®
  4. Image: Highsmith, Carol M, photographer. History of San Francisco mural by Anton Refregier at Rincon Annex Post Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph. https://www.loc.gov/item/2013630281/. Note: image cropped for presentation; no other manipulations.
  5. Phillips, Macon. June 13, 2011. “TooManyWebsites.gov.” The Obama White House Archives (U.S. National Archives): https://obamawhitehouse.archives.gov/blog/2011/06/13/toomanywebsitesgov. Accessed June, 2021. Coccaro, Kasie. July 13, 2011. “Campaign to Cut Waste: .gov Effort to Improve Federal Websites.” The Obama White House Archives (U.S. National Archives): https://obamawhitehouse.archives.gov/blog/2011/07/13/campaign-cut-waste-gov-effort-improve-federal-websites. Accessed June, 2021.
  6. 14B / 38B: GSA / Digital.gov - https://digital.gov/resources/21st-century-integrated-digital-experience-act/ 5B+ - https://analytics.usa.gov/ Image: Screenshot of the analytics.usa.gov default landing page (12:30pm on 8,31,2021). Note: screenshot cropped for presentation; no other manipulations.
  7. 4.3M: PEW/Living Facts.org - https://www.livingfacts.org/en/topics/democracy/government-by-the-numbers ~10M & ~50%: Brookings/True Size https://www.brookings.edu/blog/fixgov/2020/10/07/the-true-size-of-government-is-nearing-a-record-high/ 10,000: USAJobs.gov - https://www.usajobs.gov/Search/Results?hp=public&hp=fed-competitive&hp=fed-excepted&hp=fed-internal-search&hp=fed-transition&hp=land&hp=vet&hp=mspouse&hp=nguard&hp=student&hp=graduates&hp=ses&hp=disability&hp=overseas&hp=native&hp=peace&hp=special-authorities&p=1 175: USAJobs.gov - https://www.usajobs.gov/Search/Results?hp=public&hp=fed-competitive&hp=fed-excepted&hp=fed-internal-search&hp=fed-transition&hp=land&hp=vet&hp=mspouse&hp=nguard&hp=student&hp=graduates&hp=ses&hp=disability&hp=overseas&hp=native&hp=peace&hp=special-authorities&p=1&k=user%20experience Image: Highsmith, Carol M, photographer. Mural: "Irrigation," by Nicolai Cikovsky at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634335/. Note: image used with no manipulations.
  8. Image: Highsmith, Carol M, photographer. Mural "An Incident in Contemporary American Life," by Mitchell Jamieson at the Department of Interior Building, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634545/. Note: image cropped for presentation; no other manipulations.
  9. Image: Highsmith, Carol M, photographer. Mural: Petroleum Industry - Distribution & Use, by Edgar Britton at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634345/. Note: image cropped for presentation; no other manipulations.
  10. Image: Highsmith, Carol M, photographer. "New Deal" WPA art, Clarkson S. Fisher Federal Building & U.S. Courthouse, Trenton, New Jersey. New Jersey United States Trenton. Trenton, 2010. Photograph. https://www.loc.gov/item/2010719733/. Note: image cropped for presentation; no other manipulations.
  11. Text design idea: David Hoffer of McKinsey & Company, from his t-shirt design: https://cottonbureau.com/products/redesign-everything#/4293455/tee-men-standard-tee-vintage-black-tri-blend-s. Hoffer’s design references Daniel Quasar’s Progress Pride Flag that was the result of combining the original Multi-Colored Rainbow Flag designed by Gilbert Baker in 1978 with the Transgender Pride Flag designed by Monica Helms in 1999 and keying off of the orientation of the flag of South Africa, designed by Frederick Brownell in 1993. Kate Harrington-Rosen, Director of Equity Outreach & Education at the Northwestern University Office of Equality, “Progress Flag Initiative”. https://www.northwestern.edu/equity/about/initiatives/progress-pride-flag-initiative.html accessed August 24, 2021.
  12. Image: Highsmith, Carol M, photographer. One of four immense frescoes by Conrad Albrizio representing the industries of south and north Louisiana in the north portico of the Louisiana State Exhibit Museum in Shreveport. United States Louisiana Shreveport, 2020. -10-28. Photograph. https://www.loc.gov/item/2020744249/. Note: image used with no manipulations.
  13. Image: Highsmith, Carol M, photographer. Mural: "Fighting Forest Fire," by Ernest Fiene at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634333/. Note: image cropped for presentation; no other manipulations.
  14. Image: Healthcare.gov (10.2013). Healthcare.gov Waiting Room [screenshot]. Retrieved 10.03.2017 from: https://www.healthcare.gov/marketplace/b/create-account/. Use: PD. From a screenshot taken/posted on The Count: http://thecount.com/wp-content/uploads/healthcare.gov-waiting-room-image.jpg. Note: screenshot cropped for presentation; no other manipulations.
  15. CR facts: https://www.gao.gov/products/gao-18-368t (GAO-18-368T Published: Feb 06, 2018. Publicly Released: Feb 06, 2018.)
  16. Usability.gov on PRA Fast-Track: https://www.usability.gov/how-to-and-tools/guidance/fast-track-clearance-process.html
  17. Text design idea: David Hoffer of McKinsey & Company, from his t-shirt design: https://cottonbureau.com/products/redesign-everything#/4293455/tee-men-standard-tee-vintage-black-tri-blend-s. Hoffer’s design references Daniel Quasar’s Progress Pride Flag that was the result of combining the original Multi-Colored Rainbow Flag designed by Gilbert Baker in 1978 with the Transgender Pride Flag designed by Monica Helms in 1999 and keying off of the orientation of the flag of South Africa, designed by Frederick Brownell in 1993. Kate Harrington-Rosen, Director of Equity Outreach & Education at the Northwestern University Office of Equality, “Progress Flag Initiative”. https://www.northwestern.edu/equity/about/initiatives/progress-pride-flag-initiative.html accessed August 24, 2021.
  18. Image: Highsmith, Carol M, photographer. History of San Francisco mural "An Early Newspaper Office" by Anton Refregier at Rincon Annex Post Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph. https://www.loc.gov/item/2013630286/. Note: image cropped for presentation; no other manipulations.
  19. Sources: DOJ PRA overview: https://www.justice.gov/opcl/overview-privacy-act-1974-2015-edition Usability.gov PRA overview: https://www.usability.gov/how-to-and-tools/guidance/pra-overview.html Usability.gov on PRA traditional: https://www.usability.gov/how-to-and-tools/guidance/traditional-clearance-process.html Usability.gov on PRA Fast-Track: https://www.usability.gov/how-to-and-tools/guidance/fast-track-clearance-process.html 18F on Usability Testing and Privacy: https://methods.18f.gov/fundamentals/privacy/ PRA Digital Guide: https://pra.digital.gov/do-i-need-clearance/
  20. DOJ PRA overview: https://www.justice.gov/opcl/overview-privacy-act-1974-2015-edition Usability.gov PRA overview: https://www.usability.gov/how-to-and-tools/guidance/pra-overview.html 18F Usability Testing considerations: https://methods.18f.gov/validate/usability-testing/
  21. DOJ PRA overview: https://www.justice.gov/opcl/overview-privacy-act-1974-2015-edition Usability.gov PRA overview: https://www.usability.gov/how-to-and-tools/guidance/pra-overview.html
  22. Usability.gov on PRA traditional: https://www.usability.gov/how-to-and-tools/guidance/traditional-clearance-process.html
  23. DOJ PRA overview: https://www.justice.gov/opcl/overview-privacy-act-1974-2015-edition
  24. Usability.gov on PRA traditional: https://www.usability.gov/how-to-and-tools/guidance/traditional-clearance-process.html
  25. Usability.gov on PRA Fast-Track: https://www.usability.gov/how-to-and-tools/guidance/fast-track-clearance-process.html
  26. Image: Highsmith, Carol M, photographer. "New Deal" WPA art, Clarkson S. Fisher Federal Building & U.S. Courthouse, Trenton, New Jersey. New Jersey United States Trenton. Trenton, 2010. Photograph. https://www.loc.gov/item/2010719733/. Note: image cropped for presentation; no other manipulations.
  27. Federal Digital Strategy site: https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital-government/digital-government.html Federal Digital Strategy image: https://obamawhitehouse.archives.gov/sites/default/files/omb/egov/digital-government/digital-government.html (accessed August 2021). Note: cover image used with no manipulations.
  28. Image: Highsmith, Carol M, photographer. Mural: "Replanting the Wasteland," by Ernest Fiene at the Department of Interior, Washington, D.C. Washington D.C. United States, 2011. September. Photograph. https://www.loc.gov/item/2013634332/. Note: image used with no manipulations.
  29. Image: Register now - informal study group WPA Workers Education Project, Henry Street Settlement. New York, None. [N.y.c.: federal art project, between 1936 and 1941] Photograph. https://www.loc.gov/item/98514515/. Note: image used with no manipulations.
  30. Image: Federal Writers' Project, Sponsor. Who's who in the zoo Illustrated natural history prepared by the WPA Federal Writers Project: On sale at all book stores, zoos, and museums. New York, 1936. [NYC: Federal Art Project, or 1937] Photograph. https://www.loc.gov/item/98514973/. Note: image used with no manipulations.
  31. Image: Highsmith, Carol M, photographer. WPA mural, Cohen Building, Washington, D.C. Washington D.C. United States, 2008. December. Photograph. https://www.loc.gov/item/2010720418/. Note: image cropped for presentation; no other manipulations.
  32. Image: Highsmith, Carol M, photographer. WPA mural, Cohen Building, Washington, D.C. Washington D.C. United States, 2008. December. Photograph. https://www.loc.gov/item/2010720416/. Note: image cropped for presentation; no other manipulations.
  33. Image: Highsmith, Carol M, photographer. History of San Francisco mural "The Waterfront" by Anton Refregier at Rincon Annex Post Office located near the Embarcadero at 101 Spear Street, San Francisco, California. United States California San Francisco. San Francisco, 2012. Photograph. https://www.loc.gov/item/2013630294/. Note: image cropped for presentation; no other manipulations.
  34. Image: United States Bureau Of Reclamation. Three construction workers putting a coat of paint on a slanted wall of riveted-steel plates on the Hoover Dam spillway. Hoover Dam Nevada Arizona, None. [Between 1936 and 1946] Photograph. https://www.loc.gov/item/2008676666/. Note: image used with no manipulations.