Agile 2012 Day 2 Review

Agile 2012Day 2 of the Agile 2012 conference in Dallas, here are my notes.

Keynote: Scaling Up Excellence. Mindsets, Decisions and Principles

This keynote was delivered by Bob Sutton, author of a number of business books including “Good Boss, Bad Boss” and “The No Asshole Rule“. A similar presentation to the one he delivered is available here.

From Agile 2012
  • organisations have centres of excellence – how do you spread it from the few to the many without screwing it up? (examples – Hendrick Motorsports growing from 2 to 4 teams, McDonalds opening 1,460 stores in China)
  • shared mindset (what people should and should not do) is crucial to scaling up – Apple has a secrecy mindset, Amazon has an openness mindset, so there is no one right way
  • a mindset is required to be successful at Agile – going to a talk or reading a book is not enough, you need to grind out the message and do the same thing day after day and live by it (Facebook – employee on boarding is a six week bootcamp where they work on 12-13 short projects, focus is to inject people into the mindset and determine their best fit at the organisation)
  • the never ending danger is that things might go bad (Onward Memo by Howard Schultz – growth of Starbucks from 1,000 to 13,000 stores, in the rush to get a huge footprint, the mindset got watered down – got excited by growth and left the excellence behind)

Choice Point 1 – More vs Better

  • strategic tradeoff
  • voltage loss – things get lost in the translation, sometimes this is worth it because it is half as good as the best but twice as good as it is now
  • learning curve problem – takes people a while to get good when spreading knowledge from the few to the many
  • overload problem – burden of the management team in trying to maintain momentum

Choice Point 2 – Alone vs With Others

  • collaborate with competitors (Glad Press ‘N’ Seal), open source is one extreme, do it alone is the other (everybody at Pixar is an employee, nothing is outsourced

Choice Point 3 – Catholicism vs Buddhism (Replication vs Localisation)

  • roll out to the masses or a central set of beliefs
  • cranking out clones – works in manufacturing like Intel plants, Sees Candy and In-N-Out Burger either work in a market or not (pull out if not)
  • replication trap problem – Home Depot is a DIY model and when they rolled it out in China it did not work in their culture
  • localised solution – Buddhist approach to tweak just as much as needed to make it work

Scaling Principles

  • link hot causes to cool solutions – fire up contagious emotions first, humans are irrational, to motivate people get them emotionally cranked up (but the danger is that they get angry) so need to have a solution to cool their energy (watermelon offensive at Stanford for bike safety involved smashed watermelons and subsidized helmets or the first all-hands meeting at Apple after Steve Job’s return where the share price was not good so Jobs declared war on Dell and charged up people to make Apple great or get out)
  • live a mindset, just don’t talk about it – do actions that are consistent with the direction you want them to go, what we tell them doesn’t matter it is what they do that counts
  • when in doubt, cut it out – reduce cognitive load but deal with necessary complexity (A.G. Lafley keep it “Sesame Street simple”, Baba Shiv experiments on cognitive load for 2 vs 7 digit numbers), go simpler when trying to sell a message
    • when systems get larger and more complex, you need to deal with the complexity – Ben Horowitz “give ground grudgingly”, add people and processes only when things start to break down
    • Hackman’s rule for teams – over 6 people problems arise, more than 10 you are really in trouble, optimum is 4-6 people, Navy Seals and fire teams have 4-5 people, any more is more complicated
    • Dunbar’s number is 150 (100 to 230) – the cognitive number of relationships we can manage, pirate ships only have about 100 pirates per ship before dividing, Twitter average is about 100-200 followers
    • as the team gets bigger you spend more time on the dynamics and less time doing the job
  • little things pack a big wallop – subtle cues mobilise mindsets – design things that people barely notice but have a huge impact on their behaviour (background music, language, smells and sounds affect people’s behaviours)
    • Kathleen Vohs money research – people are less likely to ask for help or give help, will work alone when money is the object – leads to selfishness and self sufficiency
    • think about the little cues you are sending
  • connect people and cascade excellence – get one group to mentor the next to spread the excellence, grow your own replacement to get a promotion (Zynga), make your initial group diverse because more variation will give you a bigger impact
  • the mindset is the steering wheel and incentives are the juice – money is an incentive but so are pride and shame, how can I embarrass them or how can I make them proud (using mimes to mimic jaywalkers, Ben Horowitz fines people $10 a minute they are late for a meeting – it is not the money that motivates them it is the embarrassment, gets them to pay him on the spot!)
  • don’t put up with destructive beliefs and behaviours – bad is stronger than good, bad behaviours are ingrained more deeply, to spread excellence you need to stop the behaviours, bad behaviours are 5x worse than the good, destructive team members that can’t be reformed can bring down performance by 30% to 40% because you spend more time dealing with them rather than the work (Barry Feld of Cost Plus World Market would look for two things when visiting a store – greeting me and the customers and are the bathrooms clean)

Traps

  • don’t mistake swarming for scaling – raising awareness is not enough
  • too fast, too far – when people say they want to scale quick and fast, they are looking for the easy way (you are fighting a ground war not an air war)

When scaling you need to be master of addition and subtraction. – everytime you add something good, you need to remove unnecessary and bad things to make way for the good.

I also wrote an article on this session for InfoQ.

Why Agile Needs More Cowboys

Mike Griffiths presented this talk, his slides are available here.

From Agile 2012
  • do you ever see cowboys looking after cows?
  • real cowboys protect the herd, select the lead, direct into natural flows
  • agile is humanistic rather than mechanistic, so is leadership – manage property and lead people
  • “Leadership is the capacity to translate vision into reality” (Warren Bennis)
  • levels of maturity (Stephen Covey) – dependent -> independent -> interdependent
  • leadership is the next step beyond management – to a soft skills focus
  • productivity – undermining / resistance -> passive compliance -> active participation -> committed dedication -> passive innovation – move up the scale with good leadership
  • model desired behaviour – same attributes of a good leader are modeled over many years and in different countries – honest (will not knowingly follow someone who is dishonest), forward looking (describe the future state), competent (don’t want to be embarrassed by our leader), inspiring (The Leadership Challenge), a leader needs to shield the team, remove impediments, carry food and water and re-communicate the vision
  • communicate a vision – like driving in fog, without clear vision you need to slow down, clear direction allows focussed effort and speed, Jim Highsmith’s kick off meeting vision exercise, reinforce the vision frequently
  • create a learning and sharing environment – “if you have two hands to work with and you use one to cover your butt, you only have on hand left to work with”, set an example and admit mistakes and share information, ask questions of your team, make it OK to discuss the bad stuff
  • share information / power – agile tools allow move from micro management to navigation and communication
  • fostering functional accountability – accept that conflict is good, Patrick Lencioni on The 5 Dysfunctions of a Team
  • importance of the team – COCOMO Estimation model (Barry Boehm) shows that people factors has a multiplication factor of 33 (there is a 10x difference on good people over good process)
  • challenging the status quo – retrospective, “areas for improvement” works better in some cultures over “what didn’t work well”, retrospective action wheel, gathering lessons learned is one of the most frequently dropped agile practices
  • innovation and learning – if people are trying hard, then mistakes don’t really matter, Toyota collects lots of ideas with small incentives rather than one big idea
  • encouraging each other – treat people as volunteers, paying people just incentivises people to show up but volunteers are passionate, say thank you and why you are thanking them and what the benefit was, celebrate interim goals frequently, at the end is too little too late
  • shared leadership – aiming for teams of competent leaders (“Project Leadership” by Jeffrey Pinto)

I also interviewed Mike Griffiths for InfoQ.

Leading Conflict: A Systems Intelligence Approach to Conflict Facilitation for Leaders

This workshop presented by Michael Spayd and Lyssa Adkins was one of the highlights of the conference for me. The key takeaway for me was that “everyone is right… partially!” The slides are available here.

From Agile 2012

The workshop started with a discussion on the conflict we see on teams and then about why we came to the session and what we had hoped to get out of it.

  • systems oriented leadership – structured, holistic, organic, complex, end to end – move from the work level to a birds eye view
  • relationship systems intelligence – we are all in relationships – personal, work, departments
  • the human system is not in alignment with what agile does, leadership begins inside
  • see conflict through the right view – the right view leads to the right action, everyone is right partially, self organisation happens when all perspectives are represented, conflict is something trying to change in a system and not a problem to be managed

We then had a discussion around what is the benefit of the right view, is it difficult?

  • what is the difference between finding someone wrong as to finding someone right – go and hunt out why they are right
  • container – not necessarily physical but made up of behaviours, norms and culture of the team and environment

We then did an informal constellation exercise – 20 people in a circle, put the subject on a piece of paper in the middle, make a statement if it is true stand close, if not true stand away then ask those in the constellation what it means to you, need to talk from experience not what you think, remember people are right partially (take a soft focus). It is called a constellation because it looks like a star in the sky, speak from your experience, only people who wish to speak should

From Agile 2012
  • container – culture of the team, want to raise level of positivity and decrease level of negativity and toxicity, educate team about conflict and team agreement about digging into it
  • positivity and team performance – continue to abdicate your position is bad, needs to be balanced with inquiry – “not sure I agree with you, but tell me more”
  • all teams have an emotional bank account – positive interactions are a deposit and negative interactions are withdrawals, what is positive for your team and what is “flipping the asshole bit”
  • build the container – positivity vs productivity
                Happy camp     |    Insanely great
Productivity    ---------------+-------------------
                Prison camp    |    Sweat shop         
                           Positivity
  • emotional withdrawals – blaming, defensiveness, stonewalling, contempt, excessive advocacy – contempt is most prevalent on software projects
  • emotional deposits – appreciations (noticing people doing little things, in front of the group), acknowledgements, more inquiry and less advocacy
  • never praise people for the work they do, but for who they are, turn up acknowledgements and turn down appreciations
  • appreciative inquiry – look at the strengths of teams

We then had a discussion around our teams positive /negative ratio

  • dealing with cultural conflict – inquiry openness, use my land your land ” in my land we…, what happens in your land?”
  • teams move around the quadrants – prison camp is not sustainable, happy camp and sweat shop are intolerant
  • conflict protocols – team needs to come to consensus, leader needs to take a facilitator / coach role – what is the environment and behaviour we want when we are in conflict, everybody’s job is to call out the protocols when needed, not enforce them
  • be a facilitator – more helpful than resolving it, keep reviewing the right view beliefs (fake it till you make it), understand your triggers
  • process the conflict – reframe the conflict” “I wonder what this conflict is trying to tell us”
  • don’t want debate or vote, a prelude to a discussion to find out what’s true
  • we get triggered by people who are like us who exhibit behaviours we don’t like
  • Getting to Yes – Roger Fisher
  • to hear from silent others, ask “lets hear from those who have not not spoken” and then be silent

I was lucky enough to interview Michael and Lyssa with Shane Hastie for InfoQ.

The Product Owner Role is a Stupid Idea: Improving How We Handle Customer Requests

Jeff Patton is always entertaining, and I was not disappointed with this session. I would hope that his slides get published at some stage.

From Agile 2012

He kicked off the session with a live poll by getting the audience to answer the question “what goes wrong with product ownership” and then got everyone to move around the room based on experience, how well the product owner works (they don’t correlate!), internal versus external product development and the ability to change products

  • why is there a difference between developers and customers?
  • single product owners don’t work – whole teams own products
  • processes aren’t designed for success (including Agile ones)
  • safety isn’t success – Nordstromare a big successful company so they have lots of rigour around their process, nothing innovative gets through the net, so they built an innovation lab
    • waterfall model – step after step models have no feedback, Royce was trying to explain why it was a bad idea, experts have been trying to tell us why this is bad since the 70’s, traditional development models are safe
    • agile is the new waterfall – product owner creates stuff and gives it to someone else – someone to blame like the preceding process in waterfall
  • velocity isn’t value – being great at delivering software using agile then you should realise that it doesn’t matter, if we build more shit we just have more shit, we are not here to build software we are here to change the world, everything that happens (outcome) is after delivery, so need to maximize this, difficult to measure
  • underpants gnomes – a meme for something people are building but have no idea why
  • to get value you must form a hypothesis on how you’ll get it – this is the first shift companies need to make – how will we measure the output
  • one balanced team not client vendor – if we want to fail we can probably fail cheaper abroad
  • ideal product should be valuable, usable and feasible, product manager understands the value, UX or BA understands the usable, lead engineer understands the feasible, this is a balanced team – how should we build it, will they use it and how much will it cost
  • working as a team of comakers, we need to do a lot of mind reading, visibility is not good enough, shared understanding is what we are striving for
  • discovery complements delivery, morale suffers when we just build stuff, the thrill is seeing how well it works and debating the results and planning the next approach
  • story maps describe outcomes that we are shooting for
  • personas – don’t necessarily need to be accurate documentation but facilitate shared understanding
  • need face time with real people to understand, go watch people work to learn, then build models to map what you learnt (experience or journey map), when users explain a problem that should trigger an idea, share product story or product as part of a regular internal tradeshow
  • we need to understand the problems and find solutions to get us there, MVP (minimal viable product) should be the least we can build to solve a particular problem,
  • a newer version of MVP is lean startups (build -> measure -> learn) MVPe, smallest viable experiment so that we can learn and eventually earn
  • ready for release board – for each card, an explicit measure step and metrics, then before it leaves the board they need to learn
  • Nordstrom Innovation Lab learning loop – Replace the Mirrors – look for the number of learning loops, no idea on their velocity but we know how much they learned, just budget for learning – “life is better here, even though we fail most of the time”
  • you fail most of the time at predicting outcomes and getting value (Marty Cagan – Inspired)
  • making good product decisions is hard, focus on how fast we learn and how fast we get things out there
  • don’t focus on velocity and worry about who’s fault it is, focus on the things that matter

To succeed:

  • adjust your head – get out of the old client vendor model, be less like a waiter and more like a doctor and solve problems
  • take on the persona of a music producer – listen to bad music and help make others ideas better
  • be the film director – focus on the talent of the people you are working with, give direction and passion without stealing ownership

Industry Analyst Panel Discussion

I sat in the first 40 or so minutes of this discussion. Unfortunately, the room was so packed and the panel was not elevated so it was very hard to determine who was saying what. The panelists were Tom Grant from ForresterThomas Murphy from GartnerMelinda Ballou from IDC and Christopher Rommel from VDC.

  • should we stop focussing on agile adoption?
    • disagree – fewer people to execute, focus on importance, deliver benefits quickly, tackle issues like mobile and embedded
    • agree – not about how many people are doing this or certifications, there are plenty of problems to solve, a foregone conclusion, let’s tackle the bigger issues, adoption is superficial metric, plenty of challenges beyond pure software development
  • can you define ALM?
    • no agreed definition, lean concept of flow, includes the tools and processes
    • typically think about standard phases but the end to end lifestyle doesn’t work, now need to look at DevOps and cloud now, more complicated to deploy now
    • ALM tools are a misnomer, output of SDLC, fundamental issues with tools currently, we do not develop and done any more, need to start thinking about products and products have lifecycles
    • going forward will be more about traceability of past development and operations
    • worst thing is the name
  • what should we call ALM instead?
    • Application Lifestyle Context
    • Gartner are talking about this internally
    • nirvana…, once the new taxonomy is decided it will be antiquated, we are here to improve!
    • dynamic end to end process, software lasts decades longer than we expect it too, needs to sustain life
    • ripple effects of agile disrupts it
  • Gartner’s prediction of 80% of software development teams doing agile by 2012, where are we?
    • at least 80% of all IT organisations have some agile and 20% of large organisations, on everyone’s mind, businesses are talking about it, will probably still be another 10 years because big change takes that long
    • estimate that 40% of organisations are using agile, has blown past all the other methodologies, businesses realised recently that they’re not innovating
  • are we seeing issues with organisations part doing agile and part traditional?
    • often the only way organisations are initially successful, different processes (eg. software and embedded), needs to rolled out staggered and incremental
    • fair adoption in development teams, but now what does it mean to be a tester, lots of centres of excellence still exist, Facebook deploying every 25 mins scares the heck out of most traditional organisations, companies need to get to the right fit
    • majority of Agile teams are not purely Agile, use water-scrum-fall, slimming down requirements and deployments is not sprinting, Facebook analogy does not fly with corporate clients
    • need to begin where people are, approach what is the best for the organisation and adjust for the context
  • how do you measure effectiveness of Agile methods and compare them?
    • prefer not to speak about methods but rather patterns and practices, compare using customer satisfation, ROI long term for the organisation, organisations still like function points delivered because it is easier to count
    • one of the biggest pluses is on quality and that is subjective and hard to measure, metrics that can point like customer satisfaction, rework and defect counts, time to market also better, it is often a leap of faith
    • velocity interest is going down in industry, but many in the executive suite only think about velocity, a loaded word
    • don’t know soft value if you don’t baseline, now we just fix metrics inline and not all defects and features are equal, need to measure qualitative benefits to the business, will see more as metrics around Agile evolve
    • need to pull testing and quality in all the way through, drive better quality and user experiences
  • describe how you evaluate the tooling landscape?
    •  most observations come from end users, tools aren’t the key most important thing, want to understand where the market is going and what is the right fit
    • biggest differentiator is picking the right tool for the job and the organisation
    • there are tools that enhance Agile that were not built for Agile, and there are specialised tools for Agile, vendors do put thought into who they are targeting so you need to listen, we don’t live in a world where everybody gets their tools from a single place

After Dark

A huge thanks to my friends at Atlassian and Opower who allowed me to tag along to an awesome Tex-Mex joint in Grapevine called Uncle Julios.

From Agile 2012

Podcast

Finally, I recorded a short audio podcast for The Agile Revolution wrapping up Day 2 of the conference.

Agile 2012 Day 1 Review

Agile 2012With a bit of last responsible moment planning, I made the trek to Dallas (well actually Grapevine) in Texas, USA for the Agile 2012 conference. This year I was once again a reviewer on the Testing and Quality Assurance stage. This was the first year in four years that I did not have a submission accepted, however with my role as an Agile editor for InfoQ, part of my journey was to interview interesting Agile folks on camera (how cool is that!)

When somebody says that things are always bigger in Texas they are not kidding! The Gaylord Texan Hotel and Conference Center is huge, in ways that cannot be explained without seeing it. Everything is accessible without really needing to leave the enclosure (which is great because you don’t need to experience the 110 degree heat outside.

From Agile 2012
From Agile 2012

Here are my notes from the sessions that I attended on day 1.

From Agile 2012

Bad-Assed Double-Loop Learning: From Judgmental to Good Judgement

This was a workshop led by Derek W. Wade and Susan Eller. Susan comes from a medical background while Derek has experience in health care and aviation. Their presentation is available here.

From Agile 2012
  • 70% of health care errors happen due to lack of communication, similar numbers for aviation
  • transparency is starting to be accepted as a given, but still opaque in communication (people apply filters)
  • the “core protocols” help transparency
  • people in health care often perform non-health care scenarios (for a scenario that is unfamiliar to them)

We were then given a clinical scenario to watch in which a doctor is giving a medical update to a parent.

  • we observed that: the doctor gave out a broad range of data, the senior doctor fled the scene, the doctor was not looking to the parent at eye level, there was lots of technical jargon
  • our coaching advise to the doctor would be: sit down, don’t be alarming, wait for a response from the parent and address any  concerns, focus on the more likely data at the moment, know the patient, get the senior doctor to introduce the new doctor and stick around for the discussion, ask the parent if he has any needs

We then launched into talking about feedback:

  •  judgemental feedback – “I wouldn’t have done that”
  • non-judgemental feedback – sounds like you are being nice, but are actually statements that make people defensive, “the wolf in sheep’s clothing”, “do you think you could have done better?”
  • frames (mental models) – context is king, match our context to the other person and determine what frame they are in
  • ladder of inference – we can observe data and experiences as well as the actions, but everything else is within, are you basing conclusions on something observed or something inferred (The Fifth Discipline Fieldbook)

Ladder of Inference

  • you need to check in with yourself – are you using observable or inferred data
  • like the donkey’s balls vide, you need to have a WTF moment – what is your cue? Ask “where’s that from” when you have a mismatch rather than rage with WTF!!!
  • single loop interaction – inferred frame, “why we think they did it” (do something and get an outcome, repeat) as opposed to double frame interaction asking “why they did it” (do something, get an outcome, learn from the interaction on why)
  • not all about how you did it, but the way you deliver the message, need to bring to the attention of other person what you saw (your frame), need to understand why they did it
  • uncover your own thinking, use lots of “I” statements to remove defensive stance, “here is what I noticed”, “here is what I do”
  • data -> advocacy -> inquiry
  • balance with inquiry
  • as a coach if you understand the appropriateness rather than just telling them, you are doing double loop learning
  • you have a level of knowledge, so you need to understand but still use good judgement
  • “I noticed…”, “why did you do that?”, “I observed you were polling for status at the scrum… Why did you do that?” In this case, the answer was respecting the time box. Responded, “I understand that…”, “but it is my view that…”, “what do you think about that?”
  • can also do this with your spouse, teenagers (gets through the pain quicker), can also do via email, it’s not the medium it’s yourself (are you genuinely curious)?

The debrief stages are:

  • reaction – not “how did that go”, but “how did that feel”, chance to vent about any feelings
  • description – ensure we are all asking about the same problem, can you give a summary of what happened
  • analysis – use advocacy / inquiry and ask how that related and expose frames
  • generalisation – look for outstanding examples, how can we apply this learning to reinforce

Finally, when you hear yourself thinking “WTF!”, balance that with “What’s that from”

Agile Inception Deck – 10 Questions You’d Be Crazy Not To Ask Before Starting Your Project

This workshop was led by Jonathan Rasmusson, author of the Agile Samurai. Much of this workshop was common sense and very close to the Concept process I have been using and teaching for the last few years. His presentation is available here.

From Agile 2012
  • we start projects thinking we are aligned, but often we are not
  • ten questions – good for 1-6 months of planning, should take a couple of days to a week to complete
  • the last thing executives want is the team asking for more money – they prefer a larger number up front
  • at the front of a project is the time to ask the hard tough questions
  1. ask why we are here – why are we spending shareholder money and capital on this, most projects skip this, if you can go and spend time at the client site
  2. create an elevator pitch – in 30 seconds you have to be concise, in Crossing the Chasm by Geoffrey Moore there is a template for an elevator pitchfor (number one customer constituent)
    who (the problem)the (name of the project)
    is a (type of project)
    that (the intent)
    unlike (competitors)
    our (differentiation)
  3. product box – what would it look like, what are the features and the related benefits – a list the benefits; b) create a slogan; c) draw your creation
  4. create a not list – focus on what we are not going to resolve – in, unresolved and out of scope
  5. meet your neighbours – your project community is always bigger than you think ,core team -> people to start building relationships with -> then everyone else, stakeholder map
  6. show the solution – pick your architecture when you pick your team, be aware that people bring baggage, knock together a high level architectural diagram, show the challenges to the sponsors (eg. no test instances), also show the out of scope and unresolved architecture, understand gaps of licensing, etc…
  7. what keeps you up at night – risks worth taking and those that aren’t
  8. size it up – we don’t know how big – estimate in month-ers, go through the master story list, it’s a guess, not a commitment, think small, no project should take longer than 6 months
  9. be clear on what’s going to give – the secret of agile is that it does the same thing you do when you have too much to do and not enough time, dropping agile is just dropping cost (“or just sending the problem downstream to another manager” as per someone from the audience), the furious four, agile likes to bend on scope, use trade-off sliders, if they don’t want to make a decision you need to remind them that at some stage someone will make a decision, do other important stuff on a separate slider
  10. what’s it going to take – be clear on your team (who do you need, what skills, make sure you have your stakeholders on there as well to be clear on commitments), clarify who is calling the shots (especially when you have multiple stakeholders) and who will make the final decisions from a customer stakeholder point of view (who is the person with the goal), come up with a rough back of the napkin budget
  • should be 10 slides in PowerPoint or keynote – clarity, creative, drives conversation, easy to participate

Here is the deck that the table I was working with created:

From Agile 2012

A blank deck and summary is also available. Jonathan also posted some notes and pictures of the session.

Jonathan also made some time to speak to me briefly on the podcast below.

Podcast

Finally, I recorded a short audio podcast for The Agile Revolution wrapping up Day 1 of the conference, including a short interview with Jonathan Rasmusson.

Episode 43: Agile 2012 Day 5

The Agile Revolution's avatarThe Agile Revolution Podcast

Agile 2012The final day (day 5) at the Agile 2012 conference in Dallas, and a couple of really inspiring keynotes around using Agile for social good.

In-depth notes can be found on Craig’s blog.

TheAgileRevolution-43 (14 minutes)

View original post

Episode 42: Agile 2012 Days 3 and 4

The Agile Revolution's avatarThe Agile Revolution Podcast

Agile 2012Days 3 and 4 at the Agile 2012 conference in Dallas. In between roaming the corridors and talking people for the podcast (look for upcoming recordings) and video interviews for InfoQ, he attended a bunch of sessions and mingled at the after dark events.

In-depth notes can be found on Craig’s blog.

TheAgileRevolution-42 (14 minutes)

View original post

Episode 41: Agile 2012 Day 2

The Agile Revolution's avatarThe Agile Revolution Podcast

Agile 2012Day 2 at the Agile 2012 conference in Dallas. Craig covers the introductory keynote and some of the other notable sessions he attended.

In-depth notes can be found on Craig’s blog.

TheAgileRevolution-41 (11 minutes)

View original post

Episode 40: Agile 2012 Day 1 plus The Agile Samurai

The Agile Revolution's avatarThe Agile Revolution Podcast

Agile SamuraiDay 1 at the Agile 2012 conference in Dallas was workshop day. Craig recaps the sessions he attended and has a quick chat with Jonathan Rasmusson about his Agile Inception Deck workshop and his book The Agile Samurai amongst other things.

In-depth notes can be found on Craig’s blog.

TheAgileRevolution-40 (14 minutes)

View original post

AAFTT Workshop 2012 (Dallas)

Agile AllianceThe Agile Alliance Functional Testing Tools Workshop (AAFTT), was one again held this year the day before the Agile 2012 conference in Dallas. Despite there being only a small group there this year, the discussion was still open and free flowing under the facilitation of Matt Barcomb and the organisation of Joseph Wilk and Elisabeth Hendrickson.

From Agile 2012

We created an agenda for the day:

From Agile 2012
From Agile 2012

Here are my notes from the day:

Enabling Non-Programmers

George Dinwiddie led this session which turned into a lively discussion! I had proposed what I thought was a related session on Specification By Example and had combined them, but the conversation never really had a chance of getting onto that topic!

From Agile 2012
  • George expects the business people to be able to read and understand the tests
  • non-programmers should not be writing automation, it is the programmers responsibility
  • wants to be able to extract working tests into a step definition rather than needing to rewrite in Ruby (George Dinwiddie)
  • there is a difference between a specification and testing (Christian Hassa), this is a fundamental shift
  • building a DSL – talk about terminology and how we explore our domain – essential step
  • you don’t create a DSL, you build it
  • not a problem with the toolset but our training in thinking in a procedural way rather than an example way of thinking (Corey Haines
  • testers new to automation create large scripts because it’s their only hope in creating some sort of repetition (@chzy), it does not take a lot of effort and most business people are open to working this way
  • enable non-programmers by getting them to come work with us every day (Woody Zuill)
  • George is helping people make a transition, don’t want people to throw away what they have,
  • ideal is not to have step definitions call step definitions, Cucumber community is becoming a community of programmers and are moving away from this
  • Robot Framework is more keyword driven, more aligned to non-programmers, you can also make a mess, “it is a double edged sword” (Elisabeth Hendrickson)
  • testers like to test the negative cases, should they be expressed at a high level or expressed as a unit test by pairing developers and testers
  • if you are testers and you cannot write simple Ruby scripts, then you have no place on my team (Corey Haines), this opinion is probably shared by the Cucumber community (George disagreed…)
  • need to use the same design patterns in both Robot and Cucumber (@chzy)
  • in an environment that is test centric and BDD, Cucumber is the tool (usually environments with little to no QA),  in a business centric environment where you an get the business involved Robot Framework is your tool
  • Corey works in environments where there is very few Cucumber specifications per scenario, backed by lots of unit tests
  • Cucumber came out of environments where the team is predominantly developers, hence the desire to drill down to Ruby code sooner
  • at a large household name company – theyexpect testers to be more technical, happening more in the industry, eliminated the role of tester due to different pay grades (@chzy)
  • moving traditional organizations to a collaborative way of working is hard (@chzy)
  • wants simple refactorings that are are a bridge from one place to another (George Dinwiddie)
From Agile 2012
From Agile 2012

Not Testing

Joseph Wilk led this discussion on thoughts that are coming from the Lean Startup movement.

From Agile 2012
  • at a startup Joseph was at, tests were taking up to 8 hours to run and costs for distributed architecture was high
  • Forward Internet (London) – let developers do what they want – by not testing they could be faster and more interactive than their competitors – did testing in Production, a risk that sometimes things could fail – testing should not block deployment
  • in some situations it is just worth hacking it out, particularly in a lean startup
  • if it is faster to rewrite rather than maintain it, then don’t write tests (Fred George via Corey Haines)
  • a big question of this is the skill level of your developers – do you have the skill level to make the choice to not do it (Corey Haines), primary impact of success is the skill level of your developers
  • cost of failure?
  • complexity is in the eye of the beholder
  • Etsycheck error rates in Production (and decide whether to roll back or not)
  • Scribd – were having trouble with test speed and found out the developers were scared of breaking the PDF (which is the heart of the business) – they separated the PDF out to speed up development (so developers weren’t worried about breaking it)
  • quick delivery – need the quick feedback cycle to make this work, simulate production
  • need effective tests – small suite of tests that are 5-10 minutes long
  • test what you are most scared of
  • Silicon Valley’s issue is hiring – Facebook is stealing developers from Google because they hire good people and enable them to just hack it out
  • 2 software industries – small companies and large corporations, very different worlds
  • question everything – can only do this if you have experienced it before and understand it
  • need a model to help others adopt this
From Agile 2012

What Are The Better Ways To Specify Tests With Large Test Data

I unfortunately did not get to this session as it was running at the same time as the No Testing session, but here is the output from that session.

From Agile 2012
From Agile 2012
From Agile 2012

Deliberate Test Practice

Brandon Leiran led this session, trying to see if there was a testing equivalent of coding katas.

From Agile 2012
  • weekend testing group – choose a target, collaborate on Skype on their findings
  • Wikimedia Foundation – looking at ways crowd source testing to test infrastructure (rather than content) – more on this initiative to be announced in the near future
  • why is it any different to coding katas? Safer and smaller so you get more practice, practice collaboration too
  • organise a community like a book club
  • code roast – put the code up and everybody critiques it, be careful not to attach to a person!
  • get practice at driving different interfaces – Triangle Tester exercise, parking lot calculator
  • hard to practice test automation as it takes a lot of time upfron
  • take time to do charter writing sessions or test different items like cheap toys (how would you test this toy?)
  • demonstrate value of quality using simulations eg. origami games
  • add tests to open source – many of the existing tests are average
From Agile 2012
From Agile 2012

Holes / Editors

Chzy led this discussion to discuss holes in the existing frameworks.

From Agile 2012
  • the HTML report from Cucumber is very average – chzy is releasing a new gem based on discussion from a recent testing conference in Austin
  • editors – people now bundling these in TextMate, Eclipse and Visual Studio
  • JetBrainsRubyMine has gherkin support and refactoring support for Ruby, plus a lot of support for steps in Cucumber
  • big picture view of feature coverage – would be cool to map this to Sonar, suites represent functional areas, tags to represent cross-cutting concerns
  • SpecFlow is trying to map to story maps using SpecLog
  • Relish allows you to create higher level specification of your scenarios
  • there is a plugin for Cucumber that allows github integration
  • Thucydides has a built in feature coverage report
  • Twist has Cucumber support
  • test data management – FactoryGirl gem – build up snapshots but want to be able manipulate values down the stack, Faker, ActiveRecord
From Agile 2012
From Agile 2012

AA-FTT – The Future

Elisabeth Hendrickson led this session as part of her handing the leadership over to Joseph Wilk.

From Agile 2012
  • mission is to advance the state of the art of functional testing tools
  • community building is the best way to spend the money, tool builders and tool users
  • Yahoo group is main repository of knowledge, current wiki probably needs to be moved
  • need people who have time and energy and interest to take this forward
  • biggest issues with wikis is managing all the wiki spam
  • have a leadership issue to curate the content and grow the community
  • the other options are to create static content, like business analysts and leadership
  • important to have a knowledge repository that at least captures outcomes
  • would like have more organised meetings worldwide
  • is our mandate just functional testing? It has really been just about “agile testing”
  • probably need to rewrite the charter
From Agile 2012

Wrap Up

We finished up the open space by writing what action we were taking from the day and giving them to another participant to keep us honest (mine was to write this post!)

From Agile 2012

Another good open space, and good to catch up with many of the leaders in the testing community once again.

Podcast

I recorded a short audio podcast for The Agile Revolution wrapping up AAFTT.

Episode 39: Agile 2012 Day 0

The Agile Revolution's avatarThe Agile Revolution Podcast

Agile 2012Craig is in Dallas, Texas, USA at the Agile 2012 conference. Today was day 0 and the annual AA-FTT workshop.

In-depth notes can be found on Craig’s blog.

TheAgileRevolution-39 (8 minutes)

View original post

Episode 38: Coding With Exceptions (The Agile Story)

The Agile Revolution's avatarThe Agile Revolution Podcast

Mark Derricutt & Craig AspinallThis is a special mashup episode recorded in Auckland, New Zealand. Craig catches up with Mark Derricut from the Illegal Argument podcast and Craig Aspinall from the Coding By Numbers podcast. Not your usual Agile podcast, the discussion starts around the definition of Agile (“crash often, crash regulary”) and trying to define quality and ends up in a chat about wicked problems, devops and software development skillsets.

This episode has been released on the other channels as well (take a listen if you haven’t already)

  • Illegal Argument (Episode 83)
  • Coding By Numbers (Episode 37)

TheAgileRevolution-38 (67 minutes)

View original post

Episode 37: Sensational Sydney

The Agile Revolution's avatarThe Agile Revolution Podcast

Jeremie BenazraCraig and Renee take a revolutionary tour of Sydney and speak to Jeremie Benazra and Dominic Franco about the Agile work that they are doing in Australia’s big city including Kanban, cultural differences, safety and edgy Agile.

TheAgileRevolution-37 (26 minutes)

View original post