Pillars of Eternity Wiki
Register
Advertisement

CSVLoader[]

Empty? What gives? :P

Recall you were a CSVLoader expert. I'm scratching my head trying to update heaps of data from game XML files (on the Witcher wiki). It becomes tricky since I'm working with existing infoboxes, which may or may not contain the "whatever = " that I can search for. Therefore Advanced Find and Replace in AWB may be useful (I've never used it before). However, I seem to recall reading somewhere that CSVLoader didn't work with advanced search and replace, only the normal F&R. Have you tried this? Does it work with advanced as well? I was thinking that the "If" tab there could come in handy. Then I could search for each field, and if it doesn't exist insert it, and replace if it exists.

Otherwise I may have to write another script. Or... shudder... do it all manually. Darn it. This whole "minor task" became a freakin' mammoth. Why does this always happen? :D Pangaearocks (talk) 17:30, 31 March 2020 (UTC)

CSVLoader is a useful beast, but... And that's a big BUT... It requires mastery of regular expressions to use. I based on the tutorial here and it took me more than a few tries to get it right. The good news is, it can be used to update values, you just need to figure out what to input. It's the reason why I shifted towards formatting values through the infobox and using just data input straight from the files. Tagaziel (talk) 07:18, 1 April 2020 (UTC)
Have read that walkthrough as well, and think I got a test going that showed it worked to use both normal find and replace + advanced. Normal for replacing stuff from CSV file (##whatever## after regex find), and then the advanced to work more directly with the infobox. But it's messy and ripe for mistakes. It would be easier if all the "rows" were present (even without a value), but often I would have to add a row, which quickly gets messy. Ideally I could use a #if, but that doesn't work of course.
Am scratching my head because I have a 12 MB (!) XML file that is game data, that has been exported to CSV (had to write a script because none of the automated conversion sites could handle it). But actually getting that into the infoboxes, replacing/creating fields when needed, is quite tricky. There is so much data and things that can go wrong. I'll keep plugging away at it, but it wasn't as easy as I hoped.
With that last sentence, do you mean raw values in the infobox, like "12", and then add "shock damage" or whatever via the infobox template? Pangaearocks (talk) 11:24, 1 April 2020 (UTC)
Yep. If the raw value doesn't correspond to the one displayed (since it's specified in natural numbers, rather than fractions), you can always use #expr to process it. It's pretty nifty, though I don't presume to be an expert in it. You could always check if the values are hard-set or generated on the fly. Tagaziel (talk) 09:57, 2 April 2020 (UTC)
Cool. That is what I tend to prefer as well, although I had to do things a little different when working with the Witcher 3 data now. Like converting floats to integers for various effects, and integers to text for item quality (e.g. 3 -> magic). Bit of a pain, but probably easier than redoing a good portion of the infobox code (and every single item page on the wiki). And it's not like that game will get any more updates anyway. For now I've made some new columns in the CSV file, which can be used when running AWB. The regex, though, holy cow. It's giving me such a headache. It's actually easier when you have nothing to work with, in a sense, because then you just print everything and that's that. But hopefully I can get something working without too much manual editing on each page. Pangaearocks (talk) 10:14, 2 April 2020 (UTC)

Requests[]

I'm contacting you here since you seem more active here than on the Witcher Wiki, but my requests are related to the Witcher. Not sure what I've done to cause her to detest me, but I asked Game widow if it was better to ask you if I had queries, which she confirmed. So here I am.

Firstly, would it be possible to enable the CodeMirror extension on the Witcher wiki? I asked on the admin noticeboard there a while back, but I guess it wasn't noticed, hah :P It's so difficult to work on the more complex templates without syntax highlighting, so this would help I think.

Secondly, I've spent a stupid amount of time over the last month or two going through XML files. First to understand how the game deals with items, going through source code to figure out more exact details (unfortunately some is hidden inside the engine, so inaccessible), writing a script to output the whole thing to CSV (all online tools failed), and now lately I have put a good deal of it into the wiki. There are bound to be some mistakes, however, so I'd need to delete some pages, and probably move some content around. Yesterday I also asked FishTank on Discord how disambig pages impacted SEO, and the bottom line suggestion was to only use disambig pages if there were 4+ ambiguous pages -- which means some work needs to be done here too. I'm going through the masterfile spreadsheet to try to get on top of it all. Ultimately, this whole process would be smoother if I were able to delete pages myself instead of asking you, Gilrond or Game widow. Would also be nice to avoid the checkbox when purging pages (iirc, that's only for regular users). I'm also quite frankly a bit intrigued by the analytics stuff, and how much it might help us on the wiki. So with that said and done, would it be possible to become a wiki guardian? I know there are quite a few with admin rights, but seems like not many are active currently, with Smiki seemingly having moved over to wikia, who did a lot of great stuff previously.

Lastly, I hope you have a good Easter. These are very strange times, but I hope it will pass soon-ish. My sister are to get married this summer, but everything is up in the air now, if you can excuse the pun. Pangaearocks (talk) 18:02, 8 April 2020 (UTC)

Advertisement