Refinement page

Learn how to refine an initiative from an idea into something ready to be validated and estimated.

Overview

The purpose of the refinement stage is to clarify the functionality of the initiative well enough so it can be validated, estimated, and eventually prioritized.

We will learn:

  • What is needed to “refine” an initiative

  • How to move initiatives into and out of the Refinement and Refined statuses in the Jira board

For the exercise, you will refine your initiative, using your team members and instructors as pretend stakeholders, engineers, designers, and business analysts to answer questions.

The following is the Google Slides presentation for this material:

What are the goals of refinement?

Getting to a Refined status is ultimately about making sure everyone has enough detail to effectively prioritize the initiative, but not so much detail that it takes too long to make a decision.

To prioritize an initiative, you ultimately need to know how much value the initiative might create and how much effort or costs the initiative will consume.

A good rule of thumb is that the initiative should have enough detail enough to validate AND estimate it with at least about 50% confidence.

What’s needed for refinement?

A fully refined initiative will not only expand the idea content, but it will typically update the content that was provided in the idea status.

This means that the initiative’s title, description, impact, and problem statement might all be changed. Furthermore, we also recommend adding the following sections:

  • People - Who influences the shape of the story: Stakeholders, Engineers, etc.

  • High level use cases - What the user will be doing. Include positive and negative outcomes. Ideally, these are coupled with a wireframe when the use case involves a user interface (as opposed to a data operation or transformation).

  • Out-of-scope use cases - The use cases or workflows will not be included.

  • Considerations - Technical or other considerations or assumptions related to the initiative.

  • Questions - Open questions and concerns still to be answered.

The following shows the result of updating the “Promotion” initiative from idea to refined:

% Off Promotion Code and Marketing Campaign

Itsy Bitsy will offer a limited-time discount via a promotion code, distributed via a Marketing campaign.

The promotion will be a % off Promotion code that enables a discount on the entire cart.

Problem

We need to provide customers with an incentive to visit Itsy Bitsy and make purchases.

Impact

We hope to increase our revenue by 2x the amount spent on Marketing ads.

  • Value - We expect to see an increase in revenue of $100K as a result of the promo code Marketing Campaign.
  • Value confidence - 50%

People

  • Fred Ylem - CMO
  • Janice Savage - Order Engineering Manager

User Flows

Happy path user flow

Wireframe: https://balsamiq.cloud/s215txw/pjf0pgd/r201E

  1. Promotion needs to be created in Admin tool

  2. Customer see ad on TV or other channels with code

  3. Customer goes to the website

  4. Customer selects items to add to Cart

  5. Customer views cart

  6. Customer enters promotion code

  7. Promotion is applied and shows discount. There is no ability to add another promotion code.

  8. Customer checks out

  9. Receipt shows discount

Wrong Promotion Code Entered

  1. Customer enters the promotion code and hits apply

  2. Validation check against entered promotion code is done and offer is invalid

  3. An error message is displayed on screen indicated an invalid promotion code is being used.

  4. Customer given option to re-enter the promotion code

Remove the promotion code from Cart

  1. Customer enters the promotion code and hits apply

  2. Promotion is applied and shows discount.

  3. Customer selects remove button to clear promotion code entry

  4. Customer is able to add a promotion again if they choose

Promotion End Date Error Handling

  1. A customer adds the promotion to their cart before the promotion’s end date.

  2. The customer tries to checkout after the promotion’s end date.

  3. The customer sees an error in checkout with a warning the promotion has expired, and they should remove the promotion.

  4. The user removes the promotion.

Out of Scope

  • The ability to add multiple promotions at once

  • Promotion limits

  • Any other type of promotion capability

Considerations

  • This will start with a TV ad, but we may do some print media

Questions

  • Janice How will we turn off the promotion?
    A: Fred - Delete the promotion in the admin tool.
Value
100,000
Value Confidence
50

In the next sections, we will break down our approach to adding these new sections.

Writing the People Section

The people section is a list of people who should be consulted on the direction and development of the initiative. Who are the subject matter experts? What people from other departments will you need to work with? Who are the engineering and architecture leads who will help you estimate the work and guide what is in and out of scope?

Writing the High-Level Use Cases Section

The goal of defining the use cases is to try and capture the ways different users will use the proposed solution. The use cases should be end-to-end, that is, they should encompass all the major interactions necessary to result in the desired impact and solve the initiative’s problem.

We suggest writing the “happy path” use case first. The “happy path” is the most likely path that solves the initiative’s problem.

The use cases should also include the major “unhappy paths”. These are the critical paths where things might go wrong: edge cases, users doing something unexpected.

When writing these high-level use cases, there’s a few things to keep in mind:

  • It’s important to keep the use cases simple and straightforward, without much detail. You’re trying to scope out the general solution, without being prescriptive.

  • You should be looking to remove scope whenever possible. If you can release something early, get feedback, and then iterate, you’ll almost always be better off being better informed. Put any items that can be deferred in the Out-of-scope section.

These use cases will eventually be useful for breaking down the work and estimating.

Building a Wireframe User Flow

A picture is worth a thousand words. A wireframe is, by far, the easiest way of getting consensus around what a solution might look like. We strongly suggest wireframing the user journey. Typically, we end up discussing and sharing the wireframe much more than the written use cases.

The following is the lo-fi wireframe we created for promotions:

Wireframing can be a bit dangerous. The wireframes you create can be “sticky”, that is, these designs might set expectations and glue people to the specifics of the wireframe, preventing alternative user flows and designs from being explored. You hopefully have a team of highly skilled product designers and usability experts whose entire job is to determine the final design that best solves the initiative’s problem.

To balance these concerns (getting consensus while leaving room for design changes), wireframing should be done very “ugly”. Do not make the designs look nice. We suggest balamiq as a wireframing tool. It can build most user interfaces very quickly but also results in designs that are sufficiently unpolished.

Writing the Out-Of-Scope Section

The out-of-scope section is a list of features that will not be included in the release.

The out-of-scope section is arguably more important than the use case section. We should strive to limit the scope of the initiative to a Minimal Marketable Feature (MMF). A Minimal Marketable Feature is the smallest iteration of the initiative where some impact can be felt by the customer (or the product team). This is the shortest path for the team to collect feedback and continue confirming value. If you can release something early, get feedback, and then iterate, you’ll almost always be better off being better informed.

If you are a consultant, this section can be particularly important to manage customer and stakeholder expectations.

Writing the Considerations Section

The considerations section is anything that you uncover while scoping the initiative that should be retained while working through the initiative. Examples might include:

  • Technical limitations or challenges

  • Resourcing limitations or challenges

  • Related work items or initiatives

  • Any known unknowns.

Writing the Questions Section

The questions section details any questions you or other team members might have about the initiative. When answers are known, they should be included. It’s also a good idea to indicate who asked and answered the question.

Example Questions might include:

  • Questions on the use cases or wireframes

  • Questions on the technical implementation

  • Questions on timelines

The Refinement and Refined Columns

The continuous exploration board has a Refinement and Refined column.

The Refinement column is the list of initiatives that you and other Program Managers are refining. Once refinement is complete, those initiatives move into the Refined column. Finally, once an initiative is ready to be validated or estimated, the initiative will move into the Estimating / Validating column.

The Refinement and Refined columns should be sorted by priority (which initiatives have the most value).

The Refined column can be thought of as a backlog of “concrete” ideas ready to have their value more accurately verified and their cost more accurately estimated.

Moving initiatives into Refinement

If the team responsible for scoping initiatives has capacity, then initiatives can be moved into the Refinement status. Make sure to assign the person responsible for scoping the initiative.

For a product that is already released, a product manager might take on one or two initiatives every sprint (assuming that sprints are used and sprints are 2 weeks). Often, a product manager might be working through several initiatives at once as initiatives might take anywhere from 1 to 6 weeks to get ready for development.

We will go into more detail on how to manage the overall continuous exploration process in the Management part of the training.

Promoting an initiative to Refined

An initiative is Refined when it clarifies a proposed solution “well enough” to the product team so the product team will be able to:

  • Explore ideas on how to evaluate and validate if the proposed solution will achieve its goals.

  • Estimate the work

A product manager will likely have a few rounds of meetings with team members to document all the sections above. Once the product manager feels like there is sufficient clarity, the product manager should review their initiatives with the team and stakeholders before moving into the refined status.

Ultimately, the team will actually need to validate or estimate the initiative to truly know if it has enough details, but over time a product manager will develop a strong sense of when enough clarity has been achieved.

Moving initiatives to Validating

We go into detail about when and how initiatives move into the Validating status. In short, when the product team has agreed to what is necessary for validation and they have the capacity to take on the work, the initiative’s status should be changed to validating.

Exercise

In this exercise, you will refine your initiative, using your team members and instructors as pretend stakeholders, engineers, designers, and business analysts to answer questions and shape the initiative.

Step 1: Decide Roles

Unfortunately, we don’t have a full product team at this training. So the instructors and other trainees will need to pretend to be team members across the Itsy Bitsy organization.

For this step you will need to:

  1. Decide what “people” your initiative will need to involve.

    For most initiatives, you will need:

    - A product manager to help decide what is in and out of scope
    - Engineering leadership from each product team

    ✏️ Write these people in your “people” section.

  2. Decide who will perform which role.

    Discuss with the team the different people you need. The instructor will help determine which trainees or instructor(s) will take on which roles.

    ✏️ Write the specific people in your “people” section.

Step 2: Write up the additional sections

Take your first attempt at writing up the additional sections:

  • Use cases, including wireframes

  • Out-of-scope

  • Considerations

  • Questions

You will get to review with your team in the next step.

Step 3: Review with your team

Review with the people identified in your initiative. Get your questions answered.

Step 4: Update the initiative

If the initiative wasn’t clear, or there were things missing, update it.

Step 5: Final Review

Ask your team if they think they understand the initiative well enough:

  • Are behaviors well enough known that if they were to build the solution, folks wouldn’t be surprised by the result.

  • Could they “validate it”

  • Could they estimate it

If they can, move the initiative to “refined”.