Opinion > Commentary

Survey the hard way to understand hard choices


Seth Rosenblatt

Seth Rosenblatt

Implicit in the role of being a school board member is combining and analyzing multiple inputs into any decision: recommendations from the superintendent and staff, feedback from parents and the community, economic factors, and also one’s sound judgment and (hopefully) constructive dialog among board members.

Most board members will admit to struggling with at least one ingredient in this mix: getting community feedback. Often school board meetings are sparsely attended, and feedback tends to emerge disproportionately when someone is unhappy. How then does a school board get constructive input that actually represents the values and opinions of its constituency rather than just the often self-selected views of those who choose to participate?

This challenge is particularly relevant when boards need to consider budget cuts, which unfortunately may happen again if the tax measures in November fail. One of the methods often employed by school boards is to survey parents, staff, or the community at large to get feedback on budget priorities. Although there are still statistical issues with these efforts (e.g., response bias), surveys certainly gather input from a much broader base. However, I believe that most school district surveys have a fundamental design flaw that causes them to fail in getting actionable feedback as well as to leave constituents unsatisfied that their concerns weren’t heard. Why is this?

I would argue that most surveys don’t ask the relevant – or difficult enough – questions. When you ask parents “Do you value the music program?”, you almost always get overwhelming positive responses. The same dynamic holds if you ask about physical education. Or small class sizes. Or libraries. Or attracting and retaining the best teachers. It’s like asking people, “Do you think puppies are cute?” There are few naysayers. Parents, teachers, and other members of the community tend to rank most programs highly, which is rational but doesn’t give the board any actionable insight on a decision it needs to make. This is because the board’s job is not deciding whether it likes certain programs; its job is to deal with tradeoffs among them. Traditional survey questions don’t reflect this reality.

Rather, school boards should ask tough questions that do reflect this type of tradeoff. For example, “Would it be acceptable to have 2-4 extra children per classroom if it meant preserving the music program?” A much harder question indeed. Although tradeoffs are rarely this simple, this kind of question does get to the essence of the board’s challenge.

A few years ago (during another budget crisis), we posed these kinds of questions to our community. We asked people to weigh tradeoffs among programs that they likely all considered valuable, whether it be music vs. class sizes, literacy vs. counseling, or staff salary increases vs. other programs. We also tracked responses by subgroup – teachers, elementary school parents, middle school parents, other staff, etc. (the name of the respondent was anonymous but they classified themselves by group) – and we then published the results widely.

The results were extremely interesting. Everyone had a hard time with the tradeoffs – there was not a clear mandate in most of these questions. In addition to illustrating that the job of the board was a lot harder than most people appreciated, these questions helped most people recognize that although they may have been most passionate about one particular program, the obviousness of “their solution” was not necessarily apparent to their peers. There were differences of opinions both within a subgroup and across subgroups.

As an illustration of the former, there were often fairly normal distributions of answers among the teacher subgroup, meaning that they were split, for example, on whether it would be worth forgoing a salary increase to avoid increased class sizes. Although it’s very believable that the entire staff wouldn’t be of a single mind on this issue, it is not the normal feedback board members tend to get.

As illustration of the latter, our survey results showed that the parent population was more willing to trade off counseling services, but the teacher population more favored retaining counselors when faced with a hypothetical tradeoff. It reminded everyone that parents may not see the value here, as most don’t believe their children receive such services, but the teachers argued that these services had a positive “network effect” on all children and actually supported the entire school. Observing these differing perspectives gave many parents an appreciation of something they didn’t understand before.

The “hard survey” method can be applied to non-budget issues as well, including discussions around facilities, boundary changes, or other potential hot-button items. It is difficult for a school district of any size to engage constructively with its community, get broad and diverse feedback, synthesize that feedback along with expert judgment and vision, and all the while do it with limited resources and time. The community’s understanding of the true nature of a board’s decisions and the difficult tradeoffs involved will both lead to better outcomes and help build a trustful relationship between a school district and its constituents.

Seth Rosenblatt is the president of the Governing Board of the San Carlos School District, currently in his second term. He also serves as the president of the San Mateo County School Boards Association and sits on the Executive Committee of the Joint Venture Silicon Valley Sustainable Schools Task Force. He has two children in San Carlos public schools. He writes frequently on issues in public education, in regional and national publications as well as on his own blog. In his business career, Seth has more than 20 years of experience in media and technology, including executive positions in both start-up companies and large enterprises. Seth currently operates his own consulting firm for technology companies focused on strategy, marketing, and business development. Seth holds a B.A. in Economics from Dartmouth College and an M.B.A. from Harvard Business School.

Filed under: Commentary, Parent Involvement, Policy & Finance, Reforms

Comments

EdSource encourages a robust debate on education issues and welcomes comments from our readers. The level of thoughtfulness of our community of readers is rare among online news sites. To preserve a civil dialogue, writers should avoid personal, gratuitous attacks and invective. Comments should be relevant to the subject of the article responded to. EdSource retains the right not to publish inappropriate and non-germaine comments. EdSource encourages commenters to use their real names. Commenters who do decide to use a pseudonym should use it consistently.

Leave a Comment

Your email address will not be published. Required fields are marked *

XHTML: You can use these tags: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

10 Responses to “Survey the hard way to understand hard choices”

EdSource does not track who "likes or dislikes" a comment. We only track the number of likes and dislikes.

  1. Richard Moore on September 5, 2012 at 11:55 am09/5/2012 11:55 am

    • 000

    Thoughtful? It is setting the parents up for choosing between their children. Wash your hands of responsibility! Get those parents to bow down to difficult choices!

    Or.

    You can run a full school program with all the trimmings until the money runs out. Shut it down in March. Tell the parents, this is what you paid for, this is what you got. We don’t compromise quality when our children are at stake.

    Replies

    • Frances O'Neill Zimmerman on September 5, 2012 at 1:00 pm09/5/2012 1:00 pm

      • 000

      Richard Moore has a draconian point. But then the entire edu-plex would grind to a halt, and we couldn’t have that! What would State Supe Tom Torlakson and the CTA do for the rest of the year?

    • el on September 5, 2012 at 3:18 pm09/5/2012 3:18 pm

      • 000

      That’s a choice you could survey as well. :-) :-) :-)

  2. Frances O'Neill Zimmerman on September 5, 2012 at 11:38 am09/5/2012 11:38 am

    • 000

    This is a thoughtful look at the complexity of democratic decision-making in a public school district. But constructing a “good” survey is difficult if not impossible — just note el’s relevant questions above — and generally I believe such instruments are designed and used to CYA by district officials, elected and appointed, who choose to press a controversial course of action.

    There are more tough calls to be made than any survey could possible cover. Like, another school bond measure. Or turning big high schools into bunches of small ones. Or getting rid of “middle” schools and going back to grammar schools of K-8 and high schools of grades 9-12. Or keeping small class-size by impressing all credentialed teachers into classroom service. Or closing under-used school sites. Or selling off district-owned property. The list is endless.

    Replies

    • Seth Rosenblatt on September 5, 2012 at 11:54 am09/5/2012 11:54 am

      • 000

      Frances – the survey is a just a single tool to help inform a Board’s discussion and ultimate decisions. In and of itself, it is of course impossible for a survey to “answer every question.” Boards must also have many other ways to engage staff and community. But if done correctly, a survey can accomplish the objectives I mention above of both helping the community understand the hard decisions and giving the board more meaningful and actionable feedback.

    • el on September 5, 2012 at 3:18 pm09/5/2012 3:18 pm

      • 000

      I don’t think Seth suggests that everything should be surveyed or that the Board should act in lockstep with the results. It’s a way to communicate with the community about what tradeoffs are being considered, and to invite them to give input – ostensibly by responding to the survey, but also perhaps by coming to the meeting and making comment, or seeking out board members for a private discussion.

      I wouldn’t take those results as being statistically relevant, just as the one person who comes to a meeting and has a three minute comment isn’t relevant. But, the communication itself is valuable even if the results are ambivalent or inconclusive or if the Board chooses to go a different direction.

  3. CBuck on September 5, 2012 at 11:23 am09/5/2012 11:23 am

    • 000

    Good way to help make decisions that impact many when the decision is made by a few.

  4. gkoval on September 5, 2012 at 10:33 am09/5/2012 10:33 am

    • 000

    The wonderful thing Seth is that we still have school boards, and people like yourself, willing to serve the community and caring what students, parents, teachers, and taxpayers think. If the move to turn over our public schools to private ownership succeeds school boards and community input will be a thing of the past.

  5. el on September 5, 2012 at 8:36 am09/5/2012 8:36 am

    • 000

    Very nice. Seth, I quite enjoy your contributions.

    I’d like to ask a more nuts-and-bolts question, though. How were the parents surveyed? Paper surveys sent home with the kids, paper surveys mailed, phone calls or online? Did you survey the community as a whole as well? Was this just a project one board member took on, or did you seek volunteer or paid assistance?

    Replies

    • Seth Rosenblatt on September 5, 2012 at 9:19 am09/5/2012 9:19 am

      • 000

      El – that specific survey that I referenced was done online (using Survey Monkey), and emails were sent out to all families, all employees, and to some other local community groups giving them the link to the survey. This particular survey didn’t get a lot of penetration with at large community members (i.e. folks who weren’t parents or employees), but not spending a lot of money on this effort was also important. The entire board discussed doing such a survey, and then two board members (with help from the superintendent) actually wrote the survey. So, we didn’t use anyone from the outside.

Template last modified: