Code intelligence: 3.14 tracking issue

[creachadair]

Theme Increase user confidence in code intelligence provided by LSIF and make setup easier.

Sourcegraph project roadmap

Work items:

• RFC 122: Code intel LSIF delivery. Related items:
  • RFC 127: The LSIF shared-disk problem
• Strategic planning: Future directions for code intelligence.

[efritz]

Week 1 Summary

• Published new code intel extensions
• Wrote delivery plans:
  • https://github.com/sourcegraph/customer/issues/7
  • https://github.com/sourcegraph/customer/issues/9
  • https://github.com/sourcegraph/customer/issues/10
• Created fix for lsif-node (Error: There was already a managed document data for file microsoft/lsif-node#84, see Dependency Dashboard lsif-node#5)
• Patched lsif-server to accept indexes with dependent projects from lsif-node (https://github.com/sourcegraph/sourcegraph/pull/8513)
• Prune dead paths from LSIF dumps so we don't jump to 404 pages (https://github.com/sourcegraph/sourcegraph/pull/8523)
• Wrote and implemented a draft of RFC 118 to optimize the point above

Week 2 Plan 2020-02-24

• (I'm on call)
• Finalize pings
• Follow delivery plans. We should be able to reach out to start trials on Go, SemanticDB, and TypeScript indexers this week.

[creachadair]

Week 1 Summary

• Basic code intelligence for Protocol Buffer schema files (Add a basic code intel extension for Protocol Buffer (.proto) files. code-intel-extensions#241, fix: select only candidates named by the flag code-intel-extensions#243, fix: merge order of template and overrides code-intel-extensions#244)
• Investigating precise intel status for C++, Clojure, Perl, and Python to support delivery plans.

Week 2 Plan 2020-02-24

• Update/follow delivery plans where they have not been obviated.

[efritz]

Week 2 Summary

• Fixed flaky alert (https://github.com/sourcegraph/sourcegraph/pull/85830
• Fix C# provider issue (https://github.com/sourcegraph/sourcegraph/pull/8657)
• Batch expensive RPC calls to gitserver during LSIF conversion (https://github.com/sourcegraph/sourcegraph/pull/8558)
• Fix root URLs in LSIF conversion (https://github.com/sourcegraph/sourcegraph/pull/8645)
• Fix bad hover text for search-based code intel (Get content of definition, not current file for hover text. code-intel-extensions#261)
• Fix multiple-hover render issue (Do not register multiple cached lsp connections for the same root uri. code-intel-extensions#267
• Add hovers for external uses in lsif-go (Emit hover results for externally defined uses lsif-go#41)
• Add hovers package docs in lsif-go (Add package doc comments to hover text for packages. lsif-go#43)
• Update lsif-node binaries to be simpler (Update dependency typescript to ^3.8.3 lsif-node#9)
• Update lsif-node crashes on JS code (Update dependency uuid to ^3.4.0 - autoclosed lsif-node#10)
• Package lsif-node and publish to npm (installable as @sourcegraph/lsif-tsc)

Week 3 Plan 2020-03-02

• Finish analytics effort
• Submit PRs to index Netlfix OSS repositories on dotcom
• Evaluate lsif-node on more open source repositories

[creachadair]

Week 2 Summary

• Updated status for C++, Clojure, Perl, and Python.
• Code intel strategy planning, proposal.

Week 3 Plan 2020-03-02

• Fill out RFC 122: Code Intel LSIF delivery.
• Identify public Go repository samples and start indexing them.
• Improve clarity of langserver.org status.

[efritz]

Week 3 Summary

• Fixed pagination issues
• Small improvements to extensions

Week 4 Plan 2020-03-09

• Start a dog-fooding effort for uploads on DotCom

[creachadair]

Week 3 Summary

• Indexed public Go repositories for RFC 122 M1
• Test upload/updates on a local dev instance.

Week 4 Plan 2020-03-09

• Automate updates to sourcegraph.com.
• Index more Go repositories.
• Update dev documentation

[efritz]

Week 4 Summary

• Did some weird stuff with Prometheus federation
• Wrote RFC 127

Week 5 Plan 2020-03-16

• Implement RFC 127

[creachadair]

Week 4 Summary

• Updated local development documentation (docs: update macOS install instructions for nvm #8900).
• Added basic code intelligence support for Thrift schema files (ctags: enable basic support for Thrift schema files #8920, per https://github.com/sourcegraph/sourcegraph/issues/3688#issuecomment-596892054).
• Planning & strategy discussions:
  • Reviewed RFC 127
  • Wrote Future directions for code intelligence

Week 5 Plan 2020-03-16

• Index more Go repositories and automate updates per RFC 122 M2.
• Write RFCs from our planning notes.