Skip to content

Commit

Permalink
Merge pull request #1066 from usds/staging
Browse files Browse the repository at this point in the history
wh.gov link fix
  • Loading branch information
amwhitty authored Feb 3, 2025
2 parents 177cb69 + a3962ea commit 838607c
Show file tree
Hide file tree
Showing 5 changed files with 11 additions and 13 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ byline_str: "Principal Deputy U.S. Chief Technology Officer Deirdre K. Mulligan
permalink: /news-and-blog/a-call-to-service-for-talent-in-the-federal-government
---

As President Biden said, “To realize the promise of AI and avoid the risks, we need to govern this technology.” Last October, President Biden signed the landmark [Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence](https://www.whitehouse.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/). This Executive Order lays out an ambitious agenda for the United States to meet this moment on AI. It directs federal agencies to establish new standards for AI safety and security, protect Americans’ privacy, and advance equity and civil rights—while also committing to harness AI for the public good.
As President Biden said, “To realize the promise of AI and avoid the risks, we need to govern this technology.” Last October, President Biden signed the landmark [Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence](https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2023/10/30/executive-order-on-the-safe-secure-and-trustworthy-development-and-use-of-artificial-intelligence/). This Executive Order lays out an ambitious agenda for the United States to meet this moment on AI. It directs federal agencies to establish new standards for AI safety and security, protect Americans’ privacy, and advance equity and civil rights—while also committing to harness AI for the public good.

## We need your help to accomplish these ambitious and essential goals.

Expand Down Expand Up @@ -48,5 +48,3 @@ To accomplish this, the Federal Government must understand AI models’ assumpti
Our ability to meet this moment depends on you. If you want to work on important and challenging problems, join us. Here, your work can truly make a difference for the public and help forge a future where AI is a force for good that improves the lives of everyone.

There are a wide variety of roles from temporary and long term, early career and highly specialized, technical and non-technical available all over the country.

Learn more about how to join us at [ai.gov/apply](http://ai.gov/apply).
2 changes: 1 addition & 1 deletion _news-and-blog/2024-08-13-10-years-of-usds.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ permalink: /news-and-blog/10-years-of-usds
---


[*As pubished on whitehouse.gov*](https://www.whitehouse.gov/omb/briefing-room/2024/08/13/10-years-of-the-u-s-digital-service-transforming-government-for-the-digital-age/){:target="blank"}
[*As pubished on whitehouse.gov*](https://bidenwhitehouse.archives.gov/omb/briefing-room/2024/08/13/10-years-of-the-u-s-digital-service-transforming-government-for-the-digital-age/){:target="blank"}

The American public deserves a government that delivers services effectively and builds trust. In 2014, the United States Digital Service (USDS) was born. Initially formed as a crisis response team to tackle service delivery challenges, USDS has since evolved into a trusted partner for over 30 federal agencies – working directly with them to deliver superior services to the public and to build digital capabilities for the future.

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ permalink: /news-and-blog/user-research-and-the-paperwork-reduction-act

## Highlighting case studies across the government

In 2021, the Biden-Harris Administration issued an [Executive Order](https://www.whitehouse.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="blank"} to improve customer experience and make service delivery simple, seamless, and secure for Americans. Since then, government agencies have been hard at work making their services, tools, and content more effective in addressing the needs of the people they serve.
In 2021, the Biden-Harris Administration issued an [Executive Order](https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="blank"} to improve customer experience and make service delivery simple, seamless, and secure for Americans. Since then, government agencies have been hard at work making their services, tools, and content more effective in addressing the needs of the people they serve.

User research is at the heart of transforming customer experience. The best way to ensure services are effective, efficient, easy to use, fair, and safe is to include the people they are intended for when building it.

Expand Down Expand Up @@ -52,7 +52,7 @@ Specifically, there are activities common in user research that **do not** requi

- Asking people non-standardized questions as part of a one-on-one research session (i.e., asking people questions orally, in an unstructured way, about navigating government benefits or signing up for an appointment). “Non-standardized,” in this context, means the questions asked vary from person to person, and are not drawn from a list of identical questions posed in every research session.

Unlike methods that constitute information collection and require PRA clearance (for example, surveys or large focus groups with a set of the same questions or tasks), these types of research conversations (direct observations or one-on-one sessions with non-standardized questions) do not require PRA approval, regardless of the number of users ultimately involved in the research. On November 19, 2024 this was further clarified in a [briefing room](https://www.whitehouse.gov/omb/briefing-room/2024/11/21/ensuring-effective-and-timely-usability-research/){:target="blank"} blog by the White House and the Office of Information and Regulatory Affairs (OIRA) and in this [Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
Unlike methods that constitute information collection and require PRA clearance (for example, surveys or large focus groups with a set of the same questions or tasks), these types of research conversations (direct observations or one-on-one sessions with non-standardized questions) do not require PRA approval, regardless of the number of users ultimately involved in the research. On November 19, 2024 this was further clarified in a [briefing room](https://bidenwhitehouse.archives.gov/omb/briefing-room/2024/11/21/ensuring-effective-and-timely-usability-research/){:target="blank"} blog by the White House and the Office of Information and Regulatory Affairs (OIRA) and in this [Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.

Direct observations and one-on-one feedback sessions can be more valuable than [focus groups](https://www.nngroup.com/articles/focus-groups-definition/){:target="blank"} or [surveys](https://www.nngroup.com/articles/should-you-run-a-survey/){:target="blank"}, since they may provide a deeper understanding of people’s behavior rather than feelings and opinions and showcase what's working well, what isn't, and why. You can learn more about talking to people with [tips](https://www.dhs.gov/cx/how-do-I-talk-to-customers){:target="blank"} from the Department of Homeland Security.

Expand Down Expand Up @@ -126,7 +126,7 @@ During the second round of research, the main focus was observing individuals as

**Why did the PRA not cover this research?**

In this project, the DOL directly observed the experiences of program applicants and participants and asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo.](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
In this project, the DOL directly observed the experiences of program applicants and participants and asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo.](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.

### Case study 2: Conducting user research for a new application launch

Expand All @@ -149,7 +149,7 @@ The team observed Veterans using the existing application to identify pain point

**Why did the PRA not cover this research?**

In this project, the VA directly observed the experiences of program applicants and participants and engaged in unstructured one-on-one interactions. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing an online application. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
In this project, the VA directly observed the experiences of program applicants and participants and engaged in unstructured one-on-one interactions. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing an online application. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.

### Case study 3: Conducting user research to inform policy and strategy

Expand Down Expand Up @@ -222,7 +222,7 @@ The team performed user research throughout the year by working with non-profits

**Why the PRA did not cover this research?**

In this project, the groups directly observed the experiences of program applicants and participants. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing text messages. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
In this project, the groups directly observed the experiences of program applicants and participants. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing text messages. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.


### Case study 6: Conducting user research with internal users of a system
Expand All @@ -245,7 +245,7 @@ ORR contacted case workers nationwide and observed them filling out both version

**Why did the PRA not cover this research?**

In this project, the ORR directly observed case workers (not federal employees) using a form via one-on-one interviews to understand any usability concerns. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a form. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
In this project, the ORR directly observed case workers (not federal employees) using a form via one-on-one interviews to understand any usability concerns. They asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a form. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.

### Case study 7: Conducting user research with students and families

Expand All @@ -269,7 +269,7 @@ Based on this research, the team developed a College Scorecard prototype and the

**Why did the PRA not cover this research**?

In this project, the Department of Education directly observed the program applicants and participants engaging with the College Scorecard. The Department of Education also asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://www.whitehouse.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.
In this project, the Department of Education directly observed the program applicants and participants engaging with the College Scorecard. The Department of Education also asked non-standardized questions on a particular process, theme, or issue without any specification of the information being sought. [See 5 CFR 1320.3(h)(3)](https://www.ecfr.gov/current/title-5/chapter-III/subchapter-B/part-1320){:target="blank"}. This type of research was also PRA exempt because it involved usability testing a website. [See White House and Office of Information and Regulatory Affairs Usability Testing memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2024/11/PRA-Usability-Testing-Guidance-Memo.pdf){:target="blank"}.

## Ready to conduct user research?

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ Before the redesign of SSA.gov, site visitors relied on a single, static page wi

### Addressing Retirement Life Experience

When the [Customer Experience (CX) Executive Order](https://www.whitehouse.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="_blank"} was released in 2021, the USDS team worked with SSA to improve the retirement life experience. Through the discovery process, the team uncovered a lack of consolidated and connected CX data. It was difficult to fully understand the holistic customer experience and journey due to the disparate data sources.
When the [Customer Experience (CX) Executive Order](https://bidenwhitehouse.archives.gov/briefing-room/presidential-actions/2021/12/13/executive-order-on-transforming-federal-customer-experience-and-service-delivery-to-rebuild-trust-in-government/){:target="_blank"} was released in 2021, the USDS team worked with SSA to improve the retirement life experience. Through the discovery process, the team uncovered a lack of consolidated and connected CX data. It was difficult to fully understand the holistic customer experience and journey due to the disparate data sources.

To assist in solutioning the data challenge, USDS engaged with SSA two years later on a comprehensive CX data strategy, focusing on more than just customer satisfaction, but also system performance and employee burden. Through the various project phases -- discovery, identifying and analyzing data, and strategy development -- USDS further surfaced that the challenges and opportunities with retirement and Medicare processes were not unique to those specific programs. Instead, solving these common CX and employee experience pain points was foundational to improving outcomes with SSA’s highest priorities related to disability programs and various service channels (online, phone, in-person, etc.).

Expand Down
2 changes: 1 addition & 1 deletion _projects/0600_ditap.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ Current federal procurement practices rarely provide the flexibility required to

## The Solution

In 2016, USDS and OFPP created the Digital IT Acquisition Professional Program (DITAP), a Federal Acquisition Certification in Contracting (FAC‑C) certification program that trains contracting professionals to execute digital service procurements by acting as business advisors to agencies seeking to buy better digital services. DITAP leverages flexibilities in the Federal Acquisition Regulation to better acquire today’s technology and works seamlessly with digital service teams or acquisition innovation labs. Graduates of the DITAP program can also lead agency training workshops and provide consultations, expanding digital service procurement expertise across the government. In a [May 2018 memo](https://whitehouse.gov/wp-content/uploads/2018/05/fac_c_digital_services_05_12_18.pdf), OMB determined that beginning in FY 2022, contracting professionals assigned to digital services acquisitions above $7 million will be required to have FAC‑C‑DS certification.
In 2016, USDS and OFPP created the Digital IT Acquisition Professional Program (DITAP), a Federal Acquisition Certification in Contracting (FAC‑C) certification program that trains contracting professionals to execute digital service procurements by acting as business advisors to agencies seeking to buy better digital services. DITAP leverages flexibilities in the Federal Acquisition Regulation to better acquire today’s technology and works seamlessly with digital service teams or acquisition innovation labs. Graduates of the DITAP program can also lead agency training workshops and provide consultations, expanding digital service procurement expertise across the government. In a [May 2018 memo](https://bidenwhitehouse.archives.gov/wp-content/uploads/2018/05/fac_c_digital_services_05_12_18.pdf), OMB determined that beginning in FY 2022, contracting professionals assigned to digital services acquisitions above $7 million will be required to have FAC‑C‑DS certification.

![](../images/project-ditap-page.jpg)
*The second cohort of DITAP trainees.*
Expand Down

0 comments on commit 838607c

Please sign in to comment.