dotMobimobiThinkingmobiForgemobiReadyDeviceAtlasgoMobi

Posted by harri 3 years 35 weeks ago

pic
 harri
mobiForge Newbie
Posts: 3
Joined: 4 years ago
[offline]

Hi,

I'm testing the device feature detection offered by device atlas and my first test with Nokia N78 gave somewhat alarming result: the device is not recognized as a Symbian device and device atlas claims that it doesn't support uri sceme tel.

Strange is that from device information (http://deviceatlas.com/devices/Nokia/N78/entry/854218) I can see that Wurfl knows N78 to be a Symbian device but Nokia doesn't know that. From the same source I can see that wurfl claims terminal not to support uri scheme tel, but two ta-da testers have verified it does (another tester being myself).

What I think would be the best reason to use Device Atlas is to be sure that the information is correct, even if data sources like Nokia and Wurfl seem to be wrong. What are the plans how you are going to ensure data quality?

//Harri

Posted by atrasatti 3 years ago

pic
 atrasatti
dotMobi logo
Mobile Genius
Posts: 325
Joined: 5 years ago
[offline]

Hi Harri,
let me try to answer your two questions one at a time. I noticed that for the N78 (and maybe for many more) Nokia has updated the profile since when we initially imported. I've re-run the import on my development server and now the data is correct (which means Nokia confirms it's a Symbian device). So let's just say that that specific value was wrong due to an outdated imported profile.

With regards to who is right and how we assure data quality, that's a bit more complex. We have a number of partners, such as Nokia, Vodafone, etc. Some are vendors, some are operators, some are testers (like Argogroup) and all have their qualities. We rate this quality with a "trust system" where we can assign different degrees of trust to each source of information. End users using TA-DA have their own degree (each individual user).
So, when we have to calculate the final value we check all the values from each source, get the rating (degree of trust), sum all those that agree and get a total number. We then compare these numbers (given by the degree of trust) and decide which one wins.

We are all humans and we can make mistakes, even Nokia or Argogroup (that develop a device testing software as a living). We believe that getting all these sources together and assigning the correct degrees of trust lets us distill the best out of each.

We have opened TA-DA only very recently and for that reason the general degree of trust is very low. As we get more and more values from users like you, we will raise those numbers, so if you are a regular tester on TA-DA and we see that you provide good data (comparing with other sources and our own testing) we will raise your trust. So more trusted testers will easily "win" even over well known sources. Let's just say that the testing platform is currently in "training mode", but it is actually in our best interest to make sure that there is a good number of trusted testers and that the data they provide is taken in high consideration.

We are also soon rolling out a nice update that will let you get back your data as you provided it in your tests so that if you come to TA-DA and test a device and are sure that's the right value no matter what the other sources say, you'll get it back in your JSON.

I tried to squeeze quite a few points in a short post, if anything is unclear, please ask more and I'll be happy to explain better how DeviceAtlas works and why I think it's so good.

Posted by harri 3 years ago

pic
 harri
mobiForge Newbie
Posts: 3
Joined: 4 years ago
[offline]

Andrea,

Thanks for your prompt answer. It is very promising to hear about your process improvement initiatives and testing system. Looking forward to new json-file with updated information.

One more question: what is the preferred channel to report you clearly false information like N78 not being Symbian?

//Harri

Posted by daniel.hunt 3 years ago

pic
 daniel.hunt
dotMobi logo
Mobile Grandmaster
Posts: 230
Joined: 4 years ago
[offline]

Good morning Harri,

If you download a new JSON file you should see that the N78 (and quite possibly a few other Nokias) has had its values recalculated. DeviceAtlas now (correctly) recognises that it is a Symbian device and supports Image.GIF87!

And in answer to your question, there are a few ways for you to provide feedback to us about DeviceAtlas. You can email us at da.tech@mtld.mobi, you can post on our forums here on mobiforge as you have done in this case, or you can use TADA to provide device specific data to us, as you have also done!

The best way to ensure that incorrect values get fixed is to use TADA to first make sure that what you believe is true, actually is true, and then to post here/email us to let us know.

Let me know if the latest JSON works out for you or not!
Daniel

Daniel Hunt
dotMobi

Posted by harri 3 years ago

pic
 harri
mobiForge Newbie
Posts: 3
Joined: 4 years ago
[offline]

Daniel,

I downloaded new json file and now information about Nokia N78 looks much better. However, information about property "uri scheme tel" is unchanged (false) and according to my tests that property should be set to true.

//Harri