mobileOK Basic - it has teeth!

The W3C announced today the second public draft of the mobileOK test document (the first of mobileOK Basic as it is now known).
The document is has changed a lot since the version of the 12th July and I thought I'd take some time to look at some of the ways in which it has changed and to give some personal thoughts about its significance to the development of the Mobile Web.
Divide and Conquer
Initially the W3C MWI BPWG (trips off the tongue, doesn't it) was going to publish a single document covering three related but distinct aspects of mobileOK - Basic tests, more advanced tests and a scheme for labelling sites in a machine readable way.
The motivation for putting all in the same document, of course, was that the subjects are interlinked and that we didn't want to "encourage" people to think that going for the lower (machine processable) level of testing was all there was to be said about the subject. Equally, the labelling aspect is important because if you have gone to the trouble of making your site mobileOK then you'd like to be able to advertise this to crawlers and show up with higher rankings in mobile search results.
However, having taken the advice of various interested parties it was decided to de-couple the three aspects - partly in the interests of getting something out for public review in a reasonable time frame, partly because the non-machine testable aspects of mobileOK will take quite a lot more work and partly because the labelling infrastructure won't be ready till some time in the new year.
Digression - mobileOK Labels
The general subject of labelling of Web content is an increasingly urgent need which has to be addressed by a suitably flexible, machine readable and robust standard. It's really very desirable that the technical mechanism for labelling mobileOK should be the same as the one used for labelling child-friendly content and W3C WAI Accessible content to name just two of the areas to which it is relevant.
However, even a moment's thought about labelling shows that it's a difficult area, involving not just technological problems (which we can solve, usually) but social issues such as trust and trustworthiness. "Who is saying what? What are they saying it about and why should I believe them?" If you make a label saying that my site is not mobileOK and I make one that says it is, on what basis are either you or I to be believed?
But I digress - if you are interested in W3C work to find the successor to PICS then check out the work of the W3C Web Content Labelling Incubator Group (WCL-XG) and its report (draft) (co-authored by Phil Archer of ICRA and me) which act as part of the input to a W3C Working Group, which we hope will be approved soon.
Encouraging the least-common-denominator?
Aside from the very much improved tests, one of the major differences between this draft and the last one, is the inclusion of some fairly strongly worded language in the introduction about how the tests described in the document are only the beginning as far as building a mobile experience goes.
The use of the phrases "... content provider has taken basic steps ...", " ... should be considered only a first step." and "Compliance merely demonstrates that ..." is intentionally strong and is supposed to alert the reader to the idea that if you pass these tests, it still doesn't say anything about whether you have provided a useful, meaningful or pleasant user experience. And that really, if you do want to do that there's a lot more you should be doing besides passing mobileOK Basic.
This all follows a lengthy debate within the BPWG about serious concerns expressed by some members. Their concern was that by setting the bar low, people would aim low, develop simplistic sites that seemed to be mandated by mobileOK - and not develop more sophisticated and more compelling user experiences. Others felt that setting the bar too high would discourage people bothering at all, and as a consequence would not be the catalyst we all think is needed to stimulate the growth of the mobile Web.
An important part of the background to the debate is that the tests - and the acceptable results - defined by mobileOK are defined for one very specific and, on the face of it, unrealistic circumstance - what does the Web site do when accessed by the BPWG defined Default Delivery Context (DDC). The DDC is a specification of a device that has a minimal level of features to qualify it as a Web device. The idea of testing against the DDC is that while it is 'mandatory' in the Mobile Web to be able to deliver a functional experience to minimal devices it is optional, but very much encouraged to exploit the capabilities of more sophisticated devices.
An example of this conundrum is that the DDC specifies 10k of markup and 20k of total page weight. This is very limiting - and if you were to deliver pages of this size to an Nseries Nokia, you would not be giving the user as good an experience as you ought.
Needless to say, the correspondence on this in the group was quite voluminous and explored the highways and byways of almost every possible aspect - and a short-ish post like this really can't do justice either to the length of the correspondence or the impassioned tone of some of it. I confess that at the outset of the debate I was in the bar-too-low camp, but as time has progressed my view has developed - and I now find myself wondering if the Basic tests are not actually somewhat on the stringent side (OK, I changed my mind - or rather was persuaded, on balance, by the merits of the position I now hold).
In short, it's not so much that any of the tests on their own is conceptually difficult or hard to pass - it's that passing all the tests would represent a non-trivial improvement in quality for many, if not the vast majority of Web sites. As such it is one step, a relatively big step, at that, on the road to mobile Nirvana.
Non-Trivial Tests
Let's put it this way, how many Web sites actually feature valid HTML? Well if you were to run a random sample through the W3C's validation service (validator.w3.org) you'll find that really very few do. Yet, valid HTML is only one of the 27 tests of varying complexity currently defined by mobileOK. As a result, content that passes all of the tests is something really to be proud of and shows, to my mind, that the content provider (or their web developers) has taken unusual care to make it so, even if in an ideal world they look rather basic. So the important thing is to note that while there are loads of other steps you can and should take, this is the first step you need to take and by comparison with the steps usually taken in the Web today, represent a good effort.
Keeping a site mobileOK after the intitial development is, of course, a different question, and one that demands at least a minimal level of process in the maintenance activity. If you do develop Web sites, how rigorous are you about checking that the site is valid? Probably, like most developers, you check that it looks OK in the most popular browser (or possibly two) and if it looks OK, you call it a day. With an increasing amount of content being generated by content management of different sorts and by templates, of course, this is a different question to when folks used to hand code each page (OK, I still do, sigh), but looking under the stone on stuff delivered by content management and templates by doing a "show source" nonetheless reveals a fair number of scary things.
Tools
The idea of validity checking, let alone mobileOK checking, is really not that well supported by the tools. None of the several I have used recently even says a polite: "Excuse me, but you know I have HTML Tidy locally plus I also have the ability to submit this file to the W3C HTML validator? Don't you think you should be doing some kinds of verification before committing that change to the live server?".
A key, and developing theme in my mind, is the fact that the tool chain that people use is usually well short of what is needed to produce consistent and reliable results. I can't help thinking that the fact that you can write HTML pages with a simple text editor is both the cause of the Web taking off in the first place, and the largest obstacle to producing reliable, repeatable and consistent results across browser types.
Tools being a current hot button with me as they are, and if you are interested in them too, then you should check out what I can't help calling Mr Dev. Mr Dev is the dotMobi Ready checker - which gives you a rather nice display and a score. The score is a helful feature that gives you some kind of idea how close you are to conforming to Best Practices. Ruadhan and Ronan from dotMobi have put in a good job here.
Mr Dev implements most of the tests in the just-released mobileOK second public draft and is therefore a work in progress. Also check out the W3C Best Practices checker by Dom, I believe that at the time of writing this is not quite so up to date with the current draft.
Conclusion
This second draft of the mobileOK document is a significant change and improvement on the first draft. It's got a little way to go before it is stable, but in my opinion not that far. It is potentially a big contribution to the improvement in quality of the mobile Web despite the degree of qualification of the wording in the introduction.
Tools like dotMobi's Mr Dev and W3C's mobileOK checker need to be part of the way of life of developing Web sites and development tools need to help developers conform.
Jo Rabin



Posted by cranstone 5 years ago
Jo,
As I read through all the best practices etc I can't help being struck by the feeling that they are not addressing the root cause. Everything everybody is trying to do involves the server side of the equation. The Web is client - tone - server, to do the job properly involves all three sides of the proverbial coin.
Right now the single biggest problem is "What are the terminal capabilities of the device I'm talking to". You can fix content all day long, however if you don't know what the actual screen size and resolution are at the time you send the data then it doesn't matter.
I see lots of attempts to solve the client side with User_Agent... it sends out all kinds of data - the problem remains though, what is actually using at the time I want to send the content.
In the early days the WWW stood for World Wide Web... I think it should now stand for Who, What, and Where.
Who am I (so I don't have to enter meaningless data all the time) What device am I connecting with (terminal capabilities) and Where am I (real time GPS location data streamed over HTTP).
Solve those problems in real time and the web servers and content providers will be able to do their job much more efficiently.
Cheers,
Peter J. Cranstone
Peter J. CranstoneCEO 5o9 Inc
CEO 5o9 Inc
Posted by Jo Rabin 5 years ago
Hi Peter
I do agree with you that improving Web sides is one part of a complex equation.
To my mind it is an important part, in that unless there are Web sites that are worth visiting, people will continue not to bother to access the Web while Mobile.
Establishing device properties is very important. And it's also important to note, as you do, that there are 'static' properties (screen size, navigation keys etc.) and 'dynamic' properties - such as screen orientation, location and so on. This is all part of work that is ongoing - the W3C has a group about to start work on Device Description Repositories (the DDWG), which it is hoped will work closely with the OMA UAPROF. Meanwhile WURFL provides great info based on UA string matching.
Another part of this equation is that the devices really ought to work better than they do - this is improving. And yet another part of the equaition again is the cost of access to the Web while mobile (see my little moan about this which I posted the other day).
The issue of identity which you mention is something the operators could do something about and I hope we will see movement in that area soon. And yes, they could do something about location (though as you know, both these areas are fraught with difficulties).
I'm unsure as to how much benefit GPS derived data would have over info the operator has already derived from your cell location.
So all in all, yes there is a lot to do :-( but there is light at the end of the tunnel and getting the virtuous cycle started - by having Web sites that people want to visit because they stand a half-decent chance of working on their phone - is a good first step.
There's only one way to eat an elephant - one bite at a time.
Jo
Posted by srowen 5 years ago
Hear hear... not surprisingly I agree with your thoughts on this topic.
Posted by MartinWillitts 4 years ago
Is there an element of subjectivity at least at the higher levels of site quality? There are some commonly held beliefs that can probably be machine checked to some degree. Beyond that I rather suspect subjective views would play a strong part. I'm wondering if there's some way of having mobileOK(preliminary) rather like cars with a P sticker on the back. Only when enough unique beta triallists have approved rather than rejected a site for quality would it get the full mobileOK accreditation. Just a thought.
Posted by Jo Rabin 4 years ago
Hi Martin
Ref subjectivity, we try to stay away from any implication that mobileOK is a measure of usability, quality, usefulness ... there are a lot of caveats in the document itself that resulted from "accusations" that we are trying to encourage a "least common denominator" experience. In fact the caveats come thick and fast (quoting from the latest version which I hope will be published today):
mobileOK assesses interoperability. It does not measure usability and does not address the important goal of assessing whether users of more advanced devices enjoy a richer user experience than is possible using the DDC.
and then again
mobileOK Basic conformance should be considered only a first step towards building a harmonized experience for mobile users. Conformance merely demonstrates that a basic experience is available, interoperable with a large number of mobile devices. mobileOK Basic conformance says nothing about richer, more sophisticated, experiences that may be available, nor does it say anything about whether other guidelines for development of Web content (such as [WCAG]) have been followed.
and yet further
The best practices, and hence the tests, are not promoted as guidance for achieving the optimal user experience. The capabilities of many devices exceed those defined by the DDC. It will often be possible, and generally desirable, to provide an experience designed to take advantage of the extra capabilities.
Content providers should provide an experience that is mobileOK conformant to ensure a basic level of interoperability. Providers are encouraged to provide enhanced experiences as well when these are appropriate to their application and devices that are accessing them.
To turn your analogy around a bit, mobileOK conformance means you can take the 'L' plates off and put a 'P' plate on.
Jo