(The quickest way to register)

Forum

Dear visitor! The webpage is only available in English. We're sorry for the inconvenience.
  1. User picture
    • sebsauvage on Wed 10 Jun 2009
    • 09:17:16 AM UTC

    Exporting our own ratings in CSV or XML

    Is it possible to export our own ratings in CSV or XML format ?

    I mean, a simple file with: domain, date, the 4 ratings and our own comments (date,category,message).
    And only for our own ratings ?

    I'm not comfortable with web services where the data I generated is imprisonned.

Comments:

  2. User picture
    • Timo on Wed 10 Jun 2009
    • 10:20:58 AM UTC

    Re: Exporting our own ratings in CSV or XML

    At the moment it's not possible to get your own ratings or comments in CSV or XML format. You can however see all your ratings and comments on your profile page.

    Are there any others who would like to export their comments and ratings in some format?
    • User picture
      • g7w on Wed 10 Jun 2009
      • 08:19:57 PM UTC

      re: others who would like to export their comments and ratings

      Yes.
      CSV (comma, tab, semicolon, or other popular delimiter) would be nice for spreadsheet importation.

      XML with weekly RSS feeds would be nice too.

      This would enable the ability for those of us interested in keeping logs of sites we've rated and possibly help stop re-rating sites; this happens, especially with one thread mentioning domains that overlap from another, for example.
      -------
      Against Intuition - gives us safety through Web of Trust.
      WOT Community - gives us security through unity.
      Thank you all
      G7W {G.O.M}
      http://g7w.net/
    • User picture
      • soran on Thu 11 Jun 2009
      • 10:20:39 PM UTC

      it would be usefull

      to find a comment for a special domain.Currently I't s lot of clicking on the profile page necessary to find a special comment if you didn't remember exactly the name.
      It would also eliminate the needs for other search or filter functionalities on the profile page itself. General the WOT system performance would additionally benefit from this if search functionality will be done on our local clients.
      I would do the export once a week at a maximum.. It's not necessary to do it day by day.
      • User picture
        • g7w on Fri 12 Jun 2009
        • 12:59:25 AM UTC

        good point

        It would also eliminate the needs for other search or filter functionalities on the profile page itself.
        Currently a script engages a "real time total" of sites rated; this information is nice to know but the script also sorts all the domains and their associated ratings, but does not include comments.

        Switching over to a XML/RSS feed grouped into smaller blocked time segments (weekly ?) seems like it could be a more efficient method. A CSV download could be grouped into a larger block, say monthly?
        -------
        Against Intuition - gives us safety through Web of Trust.
        WOT Community - gives us security through unity.
        Thank you all
        G7W {G.O.M}
        http://g7w.net/
  3. User picture
    • sebsauvage on Thu 11 Jun 2009
    • 09:30:12 AM UTC

    Uses

    It can also be usefull to track websites more easily, especially those we have tried to shutdown.
    Or to search in comments.
  4. User picture
    • Timo on Fri 12 Jun 2009
    • 10:47:00 AM UTC

    Re: Exporting our own ratings in CSV or XML

    Seems that there are a couple of persons interested in this and I understand why you would like the feature. I will put this export feature to our future developement list. However, I would not hold my breath while waiting.;)
  5. User picture
    • g7w on Sat 29 Aug 2009
    • 06:31:44 PM UTC

    re: Exporting our own ratings in CSV or XML

    *bump*

    I realize WOT has much going on and that they are also looking for more developers for assistance, I just wanted to bump this thread back into "forum view" for some who may not know about this discussion and might wish to voice their own opinions.

    Personally, I'm still "all for it"

    @Timo
    I'm not holding my breath but I do have my fingers crossed. :-)


    -------
    Against Intuition - gives us safety through Web of Trust.
    WOT Community - gives us security through unity.
    Thank you all
    - G7W
  6. User picture
    • Sami on Fri 11 Sep 2009
    • 03:55:00 PM UTC

    Re: Exporting our own ratings in CSV or XML

    You can now download your ratings and comments on the "My ratings" page. We'll document the XML format next week, but it should be fairly self-explanatory in the mean while.
  7. User picture
    • sebsauvage on Fri 11 Sep 2009
    • 07:25:10 PM UTC

    Thanks !

    Great !

    Thank you.
  8. User picture
    • The Big Bin on Sat 12 Sep 2009
    • 10:03:18 AM UTC

    -

    Great idea!

    --
    Per aspera ad astra
  9. User picture
    • g7w on Sun 13 Sep 2009
    • 04:18:38 AM UTC

    re: You can now download your ratings ...

    Would it be possible to allow a User Selection of either date [definable range] or natural order; i.e., Ratings 1 - 50,000 | 50,001 - 100,000 | etc where the chunk size is user definable.

    The reason is...
    My ratings .ZIP file was compiled on 10 Sep 09, though I made my first attempt to retrieve it on 11 Sep 09 and it is ~ 6.13MB compressed, once the XML is extracted it grows to 119MB.

    My old PC doesn't have near enough RAM for any editor (XML or text), XML reader, or office suite that could open and display the content. When I did try an import into a spreadsheet, the default selected options informed me the compile date was the 10th of Sept. and the default language was in German; shouldn't the XML language, if specified be the same as what the user has selected as default on this Forum? Maybe default language should be a editable / selectable option in the Profile Settings, or better yet, a selectable option in WOT Settings.

    The ability to obtain smaller "chunks" of ratings into smaller XML files would not only reduce bandwidth for both WOT servers and the user, but would also eliminate redundant entries. For example, I would personally attempt to download by Natural Order in chunks that would be acceptable to my RAM ability - 50k blocks might work, so I would create 6 XML files: 1-50,000 | 50,001-100,000 | 100,001-150,000 | etc. to gather my full list of ratings to date. Once retrieved, I would then resort to date ranges to remain current. If I were to delete a rating, an F/P for example, I could manually search my converted XML file (spreadsheet, database, etc) and ensure the rating was removed from my "records" - actually, I would create a new file that would transfer from rated to deleted for reference.

    Concerning CSV...
    It might import / convert better than an XML since it would be a much smaller file size; no XML tags are needed

    The information concerning WOT Ratings is tabular data and there is The Cost of XML
    He [Stephen Beller] saved data from Excel into both XML and CSV:
    • The XML file was 840MB, the CSV 34MB -- a 2,500% difference. Compressed, the XML file was 2.5MB, the CSV 0.00015MB (150KB) -- a 1,670% difference.
    • Equally dramatic is the time it took to uncompress and render the files as an Excel spreadsheet: It took about 20 minutes with the XML file; the CSV took 1 minute -- a 2,000% difference.

    just a few thoughts.
    -------
    Against Intuition - gives us safety through Web of Trust.
    WOT Community - gives us security through unity.
    Thank you all
    - G7W
    • User picture
      • Sami on Sun 13 Sep 2009
      • 09:05:00 AM UTC

      Re: You can now download your ratings ...

      My old PC doesn't have near enough RAM for any editor (XML or text), XML reader, or office suite that could open and display the content.

      You can use a better text editor, which doesn't load the entire file into memory, or a program that splits the file into smaller chunks (search Google for more alternatives).

      shouldn't the XML language, if specified be the same as what the user has selected as default on this Forum?

      The XML file doesn't specify a language. Your spreadsheet probably tried to detect the language and failed.

      Concerning CSV...

      I'm not a huge fan of XML either, but it's flexible, human readable, and pretty universal, so we have no plans to offer alternative formats at the moment.

      Edit:

      Here's a small Perl script that splits the exported XML file to smaller chunks. I tested it on Linux, but it should work on Windows too with ActivePerl. If you want to split the exported file to chunks containing 10000 ratings each, for example, run this command:

        perl splitwot.pl exportedfile.xml 10000
  10. User picture
    • Sami on Tue 15 Sep 2009
    • 01:34:23 PM UTC

    Re: Exporting our own ratings in CSV or XML

    The export file format is now documented in the WOT wiki.
    • User picture
      • Creastery on Tue 06 Oct 2009
      • 09:35:57 AM UTC

      Okay...now exporting is out...

      So can there be a mass edit function?
      People like me who is kinda busy may like this idea...
      So if we use this mass edit function, we can change our comments and ratings faster.
      Also, we can just limit to gold members and I am sure it would not lag the server too much I hope.
      If it is feasible, reply and continue this thread...
      :)
      ☆¢σρчяιgђτ ©2009 ©®eαšтeяч™☆
      Visit http://wintechpedia.co.cc for tech tips.
      Note: http://wintechpedia.blogspot.com is our previous website.