Managing Large Scale Drupal and Agile Culture by Dinesh Waghmare, - - PowerPoint PPT Presentation

Managing Large Scale Drupal and Agile Culture by Dinesh Waghmare, TCS

Myself @DrupalCon Dublin 2017

What is Large Scale Drupal?

Traditional Clients

• Top Product organisation want to promote there product, connect with customer base and would like to

manage content and customer interaction Functional Requirements Ø Product Promotion section with pages Ø Home Page, Product Feature slideshow, Inner Page Product Promotion and Offer Box Ø Customers Registration Ability to log ticket, feedback, subscribe for new updates of product Ø Lead generation forms, Email newsletters for subscribed users should be available

Ø Web Content is Focused

UI/UX Requirements Content Requirements Other Requirements Ø Portal should allow look and feel to match product characteristics Ø Navigations, Content styling should be easy to handle and update Ø Browser Based Focused Desktop , Mobile and Tablet View Ø Editor should able to draft /review / publish / unpublished content pages and promotion box, add navigations Ø Media management for Image /PDF assets Ø Guest / Role based Content Ø Low cost Ø Site analytics for user interaction like manage form submissions, content view/downloads Ø SEO Ø Fast Response Time Ø Security? Ø Performance? Ø Deployment / Rollout? Ø Tight Backend and Frontend Integration Ø Single Site / Multi Site

Enterprise or Digital organisations Clients

• Top fortune 500 organisation with multiple set of brands looking for solution to manage existing brand specific

websites, launch new template for common brands, have centralised user base, Omni channel marketing with 360 degree view of data analytics Functional Requirements Ø Migration Strategy for existing websites Ø Common Platform or Template for rollout Ø Single sign on with central user dashboard Ø Ability to override platform and features Ø Multi Country - Multi Language Ø Data driven Ø Omni Channel marketing experience UI/UX Requirements Content Requirements Other Requirements Ø Different templates for different content like Page / News / Product / Forms etc. Ø Responsive UI, UI effects, Navigation effects, Accessibility Ø Responsive Support for Media Ø Uniformed Styling Ø Accessibility Ø Layout Ø Any Screen, Any Device Ø Editor workflow for content and media Ø Centralised content management to cater content to multiple channel Ø Personalisation – Personal and Contextual Content Experience Ø Highly Scalability Ø Highly Secured Ø High Performance Ø Easy to Deploy and Rollout Ø Easy maintenance and Support Ø Cost Reduction Ø Automation Ø Embrace multi vendor – decoupled agency Ø Agility Ø Decoupled, Distributed Architecture Ø Site Factory

How does Enterprise or Digital organisation look like?

Ø Big Enterprises Ø Big Plans : Web , Mobile, Connected echo system Ø Digital Transformation Strategy : Analytics, Integration, Automation, Omni channel , 360 View Ø Multiple Stakeholders and Product Owners: Customer and Data centric strategies, Dashboards and Reporting Ø Multiple initiatives , Multiple globally distributed Partners , Multiple Projects Ø Improve Speed : Performance, Scalability Ø Reduce Cost : Reusability, Easy workflow, Optimum use of resources and infrastructure and tools Ø Innovate Fast : Faster Deployment, Frequent releases, Integrations to channels, Automation, Strategic solutions, Plans for Future Ø On time support : Easy customisation, Community releases, Security fixes Ø Focus more on strategy while collaborate on solutions Ø Share challenges - knowledge - New Opportunities Ø Multi vendor – Decoupled agency

What does Enterprise or Digital organisations looks?

Ø State of Drupal : Drupal scale from small to large, no longer for Simple sites (Blog/Portfolio/Brand) but for sites with medium-to-high richness (community portals, integrations sites, Omni-channel websites, multi site platform ) Ø Drupal is for addressing Ambitious Digital Experience which is much more than just enterprise Ø Big enterprises - Big Plans, Digital strategies, Multiple Stakeholders Ø Enterprise targets for Mega trends (AI, SaaS, IoT, AR, Voice Assistance, Chabot's) and Drupal is getting better with adoption of new technologies Ø Take off popular myths & facts about open e.g. security, selling data, "free" / costs Ø Lone Wolves Lose Out : Are you having active participation and collaboration in Drupal Community, DrupalCon? Ø Contribution and giving back Vs participations Ø Open Source : Thousand Eye , Faster Testing, Constant reviews Ø LSD means - Focus more on strategy while collaborate on solutions Ø Share challenges - knowledge - New Opportunities : Events, Camps, Cons, Code Sprints Ø Contributions and expertise from enterprise organization will help to keep Drupal “Longer”

Drupal Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

Drupal Features

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Performance
• High Volume
• Content

Publishing

• Architecture
• Monitoring
• Load Testing

Challenges in High Scalability

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Multiple

Screens and Testing

• Regression

Challenges in Mobile First

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• API First
• Inventory
• Testing
• Uniformed

gateway for data

Challenges in App Integration

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Vulnerability
• Penetration
• Security

Advisory

• Best Practices
• Continuous

Integration

Challenges in Security

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Access

Permission

• Content

Workflow

• Continuous

Integration

• Content

Auditing

Challenges in Content Authoring

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Managing

Configuration

• CMI/Features
• BDT
• Optimization

Challenges in Content Architecture

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Use Case
• CI/CD
• Brittleness of

a Single Codebase

• Single Points
• f Failure
• Illusion Vs

Simplicity

Challenges in Multisite

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Distributions
• Platforms
• Builds
• Headless
• Automation

Challenges in Business Solutions

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Provisioning
• Rollouts
• Service

Provider

• Future need?
• Node JS
• Apache Solr
• Varnish
• Memcache

Challenges in Platform Stack

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Headless

Drupal

• Site Inventory
• Stack

Provisioning

• Continuous

integration

Challenges in Content as Service

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Common

Initiatives

• Contributions
• Collaboration
• Participations
• Open Culture

Challenges in Community

D8 Highly Scalable Mobile First Integrated Applications Security Content Authoring Content Architecture Multisite Tools for Business LAMP stack Content as a Service Community Multilingual

• Theming
• External

Translation Vendor

• Translation

Hub

• Regression

Challenges in Multilingual

Big Picture

Perspective of Development Stack for LSD Process, Tools , Solutions

Tools and Solutions

A. Drupal Distributions, Profile, Builds B. Editorial Flow + Deploy, Workflow, Workbench, Layouts

• C. Architecture

Ø Static Vs Dynamic Vs Hybrid Ø Single Site, Multi Site Ø Standalone Portal Vs Global Portal Ø API First Vs Content Only Ø Monolithic CMS Vs Decoupled CMS

• D. IDE, Drush, Composer, Drupal

Console E. VM, Docker, LAMP Stack, XAMPP, MAMPP F. Git, SVN

• G. Jenkins , Travis
• H. PHPCS, Coder, JS Lint, CSS

Lint I. Behat, Selenium, wraith J. Modules, Libraries, Features K. Sub Theme L. PoEdit

Process and Requirements

A. Product Requirements B. Content Publishing and Content Workflow

• C. Architecture
• D. Dev Tools

E. Stack F. SCM

• G. CI/CD
• H. Best Practices

I. Testing J. Features K. Theming L. Translation

Development

Perspective of Platform Infrastructure for LSD Process, Tools , Solutions

Tools and Solutions

A. Jenkins , Travis, Pipeline B. Git, SVN

• C. Shell, Python, Drush
• D. Docker, Ansible, VM

E. Codebase Platform, Sub- Platform, Custom and Contrib Tracker F. LAMP / NodeJS, / Angular, MongoDB / Couch-PouchDB

• G. Distributions D7 / D8 / Site

Factory

• H. Make file / Composer +

Drush + shell I. Tagging J. CI+CD Automation K. Scalability, Cloud – PaaS, SaaS L. Acquia, Platformsh, Pantheon AWS etc.

• M. Iron.io

A. Continuous Integration B. SCM

• C. Automation
• D. Provisioning

E. Codebase Platform F. Stack Provisioning

• G. Distributions
• H. Deployments

I. Builds J. Rollouts K. High Volume L. Service Provider

• M. Automation

Platform Process and Requirements

Perspective of DevOps for LSD Process, Tools , Solutions

Tools and Solutions

A. Anisble , Docker B. (Code / DB / Files) Sync

• C. Drush sql-sanitize
• D. S3 Backups

E. Profiler, Logstash F. Slack Bots, Wormly

• G. Drupal Security

Announcements

• H. Central Access

Management I. Site Audit J. Content review, Content Audit Logs, Revisions K. Hacked L. Webhooks, Bots A. Environment Provisioning B. Environment Sync and Clone

• C. Sanitations of Data
• D. Backup Management

E. Centralised Log F. Monitoring

• G. Security Advisory
• H. Inventory

I. Access Permission J. Content Auditing K. Module Monitoring L. Communication and Tools Integrations

DevOps Support and Maintenance Process and Requirements

Perspective of Testing for LSD Process , Tools , Solutions

Tools

A. Blaze Meter / jMeter , New Relic B. Behat, SimpleTest, Drulenium,

• C. Wraith, PhantomJS /

PhantomCSS, backtrac

• D. Site Audit, Security

Review, Hacked, CMSmap , Wapiti , E. fod-dev F. Drupal Cache, Compression, CDN, Varnish, Cloudflare

• G. Memcache, Redis

A. Performance & Load Testing B. Regression Functional

• C. Visual testing
• D. Vulnerability Testing

E. Penetration Testing F. Optimization Front End

• G. Optimization Backend

Testing Process and Requirements

Perspective of Community Presence for LSD Process, Tools , Solutions

Tools and Solutions

A. Drupal Camps, Drupal Cons, Code Sprints, blogs B. Drupal Initiatives like Content staging stagey, Media initiatives

• C. Module Sponsorship,

Code Sprints, Drupal Credits

• D. Participation, Partnership

E. Business Summits F. Open Source Forums A. Community Presence B. Common Initiatives and Trends

• C. Contributions
• D. Collaboration

E. Leadership F. 3rd Party Service Providers Connect

Community Process and Requirements

Integrating Agile for Large Scale Drupal Projects

Ø Multiple Team

Ø Engineering Ø Development Ø Maintenance Ø Support (L1/ L2/ L3/ L4) Ø Documentation Ø Confluence Ø JIRA Ø Wiki

Ø Communication

Ø Slack / Skype

Ø Meting

Ø Webex Ø Hangout

Ø Planning

Ø JIRA, Asana, Aha Ø Planning

Ø Learning Tools Ø DrupalCon / Drupal Camps / Open Source Conf Ø Lynda.com / Youtube Ø Agile Workflow

Ø Development Iterations Ø Scrum, Daily Stand-ups Ø Weekly Demos and Sprint planning, User Stories, Storing Pointing Ø Retrospectives Ø Effective Communication and collaboration

Ø User Roles

Ø Product Owners Ø Scrum Masters Ø Project Managers Ø Developers

Ø Project Releases

Ø Branching Ø Tagging Ø Critical Releases Ø Documentations

Ø Tools Selection

Ø JIRA, SLACK, ZENDESK

Ø Global Team Structure

Digitalization for Enterprise or Digital organisations

Ø Digital Ø Content and User Journey : Mobile to Digital ü Voice by Default ü Contextualization based on data Ø Mega Cognitive Trends Adoption ü Chatbots ü Augmented Experience, WebVR / VR ü Voice Assistance - Voice Search instead Apache Solr ü Image Recognition and Search ü Internet of Things - Connected Content and Data ü Micro-services / Everything as Service ü Artificial Intelligence and Big data ü Decentralized + API Ø Creative over AI Ø Drupal Ø API First, not API only : REST , JSON API / GraphQL , OAuth, Framework / SDK’s Ø hybrid, Headless CMS - Flexibility for Multi Front End, Flexi Backend development Ø Migrate Fast - D72D8, Non Drupal to Drupal 8 Ø User Experience - Workflow, Layout, Content Staging and Preview, Media and Forms Ø Cross Community Contribution - Process, Tools, People Ø DevOps Ø Automate Everything Ø Agile

Build Small – Build Smart – Grow Large

Ø Build Prototypes – Build Small – Build Smart Ø Communicate Often Ø Plan Project Tracking , Support and Ticketing Ø Plan Scope and SOP Ø Keep building KEDB Ø Reactive Vs Proactive Ø Adopt Tools Ø Local and Global Teams Ø Estimate Smart Ø Community Presence Ø Plan Governance Ø Do it Locally Work on Production as well

Common Challenges

Ø Deployments ( Content / Configuration / Code / Files) Ø Turnaround time on Support (Sync / Backup / Environment Refresh / Rollback ) Ø Planning Reactive Ø Being Agile Ø Keeping Learning Curve with Community Trends Ø Keeping Priority and Criticality Ø Build Custom Vs Go Open Source Ø Auditing and Compliance (Content / Versions / Users ) Ø Multiple Initiatives and Diversity Ø Global Development and Support

Thank You Drupal Camp Goa 2018 https://drupalcampgoa.org Drupal.org TCS Dinesh Waghmare