Deprecate Drupal legacy database structures/naming

[jywarren]

This used to be a Drupal site (back in https://github.com/jywarren/plots days!)

This is a complex, multi-part issue which should be broken up into smaller issues, but just to provide an overview:

The legacy Drupal stuff is almost eliminated, but is confusing for new contributors -- mostly at this point it's:

The word Drupal on some models

We could rename DrupalNode to Node, for example, and this line in the model would then be unnecessary:

https://github.com/publiclab/plots2/blob/master/app/models/drupal_node.rb#L20-L21

But this would need to be a find/replace throughout the codebase!

The filename here: /app/models/drupal_node.rb could then become /app/models/node.rb

So, in summary, we've completed:

• DrupalNode => Node
• DrupalNodeRevision => Revision (DrupalNodeRevision => Revision model renam #1496)
• DrupalComment => Comment (done by @ashleypt in [in-progress]Fix/change drupal comments to comment. Part of #956 #978)
• DrupalTag => Tag (done by @ashleypt in drupal_tag => tag #1178)
• DrupalNodeCommunityTag => NodeTag (not UserTags as that'll be for tags upon users; drupal_node_community_tags => node_tags #1495)
• DrupalNodeCounter => NodeCounter
• drupal_profile_field.rb - this and the below are used only for storing bios which could be migrated to the User model as a text field. - moving to User.bio in bio field now part of User; status moved off of DrupalUser #1497
• drupal_profile_value.rb

Remaining to refactor

There are a few others, but we should look into how heavily they're even used, as we could start a new project to begin simplifying/deprecating older models:

• Code related to Answer model (not Drupal but we do want to deprecate it): https://github.com/publiclab/plots2/search?q=answer
• drupal_content_field_image_gallery.rb - these could be merged into (added before) the body content field of the nodes they're attached to and this "gallery" feature finally dumped (broken out into Refactor legacy gallery code into node revision body #4074)
• drupal_content_field_map_editor.rb - this and 2 below could be merged into the map node body field and not stored as separate records
  • drupal_content_field_mapper.rb
  • drupal_content_type_map.rb - Begin converting Map nodes into normal note nodes #4072
• drupal_main_image.rb - currently switching between this and a new one on these lines but could migrate old ones forward
  • Remaining DrupalNodeMainImage records can become plain Image records -- This could happen with a migration: migrate all DrupalNodeMainImage to native Image records #76
• drupal_file.rb - we could (with drupal_upload, below) just append files to the content of each node (which would use the Image model, actually) and get rid of these. Actually so I think we can just take the URL of the file, and add a new section to the bottom of the node, called ### Files and just make a list of the URLs to the files. I think this should work for most or all of these? Then we can delete the records -- the uploaded files themselves will remain!
• drupal_upload.rb - this last one has no records, as far as I can tell... but links node to drupal_file so we should be able to get rid of this model and table at the same time as drupal_file.rb

[aayushgupta1]

@jywarren I would like to work on this as no one is currently working on this. Could you just explain a bit more?

[jywarren]

This is a pretty big and complex one, but I think you could try doing a
piece of it. For example, changing all instances of "DrupalComment" to
"Comment". Do you have a good tool (text editor, command line utility) for
doing find/replace across lots of files?

You'd also want to change "drupal_comment" to "comment" where that happens
as well. And it'll be likely to fail some tests when you first do it, but
that'll be part of the process.

On the other hand there may be a number of more clearly defined projects
you could take on that could be more suitable, as this one may be
frustrating! Just a fair warning :-)

[aayushgupta1]

Okay. Thanks @jywarren . Which text editor would you suggest? Also if I am able to change it all, will there be any failures?

[jywarren]

If you change everything in /app and /test, I think it will be ok but I
don't know for sure.

What system are you on? On a Linux system there's some combination of "sed"
that can be used... But it's a bit obscure to use. Search for "sed replace
across files" on stack overflow?

Perhaps the Atom editor can do this?

https://atom.io/

@jywarren Hi I can take on changing stuff to use User instead of DrupalUsers if @aayushgupta1 is just changing the other stuff. let me know if you have any tips on how to do it and then ill figure it out :)

@aayushgupta1 I highly recommend Visual Studio Code as a text editor on Windows, Mac, and Linux. Atom is a close second but I prefer Code because it is much ligher, has better git integration and js support, and often has better autocomplete.

Once you install code, install the Ruby extension as that will make working with a ruby on rails project much easier. If you work with Python, for example, you can also get an extension for that which has amazing autocomplete out of the box :)

looking forward to working with you guys on this one! :)

[jywarren]

Wow you two -- this sounds good, and the key here is the tests -- these
namings are so thoroughly peppered throughout the codebase, that:

a) if we break things, tests should show it
b) but only if our tests are really thorough!

We've come a LONG way on tests, and now have hundreds (!) but just a heads
up that this is an ambitious project to take on. But I'm here for you! I
might recommend that you take this on one at a time, however, because if
you edit the same files, you'll likely encounter some merge conflicts.
These aren't impossible to get around by any means, but again, just watch
out.

Much admiration for your interest in this! Thanks, and just take it one
step at a time!

[aayushgupta1]

@ashleypt Sure. I will take up the drupal_node to node part. @jywarren can you check out line 291. If I remove drupal from there, what do I insert?

[aayushgupta1]

@jywarren It's a great comfort to know that we have you support and look forward to work with you and @ashleypt .

[jywarren]

Oops, line 291of what file? I'm on my phone so could you link directly?
Thanks! 🛬

[aayushgupta1]

@jywarren https://github.com/publiclab/plots2/blob/master/app/models/drupal_node.rb#L291

[jywarren]

@ashleypt perhaps you should try drupalcomments or drupaltags first, as DrupalUsers is extra complex and let's get the easier ones first to ensure this whole process works!